Overview
Senior Quality Assurance Engineer Jobs in Abu Dhabi Emirate, United Arab Emirates at Searchability®
Title: Senior Quality Assurance Engineer
Company: Searchability®
Location: Abu Dhabi Emirate, United Arab Emirates
Senior QA Automation Engineer (AI / LLM)
Senior QA Automation Engineer (AI, LLM, Conversational Agents), Leading AI Company, Abu Dhabi
KEY POINTS
- Hybrid in Abu Dhabi, 2 to 3 days a week onsite
- Own quality across cutting edge generative AI and conversational agent products
- Real LLM testing, hallucination, bias, toxicity and PII checks, golden sets, non deterministic assertions
- Senior role, 8 or more years in QA automation with genuine AI testing depth
- Arabic speaker essential
- Salary around 30,000 AED per month, with room for exceptional candidates
ABOUT THE CLIENT
We are supporting a leading AI company building generative AI and conversational agent products at serious scale. This is a frontier AI organisation with the ambition and resources to match, and quality engineering sits right at the heart of how they ship responsible, reliable AI.
This is a modern QA role at the edge of the field, testing non deterministic AI systems rather than traditional regression work. If you have moved from classic QA automation into AI and LLM testing and want to work where that discipline is being defined, this is for you.
THE ROLE, SENIOR QA AUTOMATION ENGINEER
You will own the quality strategy across complex data flows and AI driven products, with a particular focus on conversational agents. You will design generative AI testing scenarios, build evaluation frameworks for LLM behaviour, and run the safety and quality checks that keep these systems reliable and responsible. You will work closely with the ML and NLP teams to define what good looks like for agent performance.
This is a hands on senior role combining deep automation expertise with strong analytical judgement, spotting the subtle inconsistencies in data and agent behaviour that matter.
KEY RESPONSIBILITIES
- Design and execute generative AI test scenarios, including exploratory testing for chatbot interactions, intent recognition, tone and edge case behaviour
- Build LLM test designs, prompt and grounding validation, golden sets and non deterministic assertions
- Run safety and quality checks for hallucination, bias, toxicity and PII leakage
- Validate structured and unstructured data outputs for consistency, accuracy and compliance
- Establish real time testing approaches including streaming data validation and API monitoring
- Collaborate with ML and NLP teams to define evaluation metrics for agent performance
- Integrate AI tools such as Copilot and Claude into the QA lifecycle to accelerate test design, documentation and defect analysis
ESSENTIAL EXPERIENCE
- 8 or more years in QA engineering, with proven automation testing experience
- 5 or more years testing data systems
- Strong experience using AI applications and LLM based assistants in testing
- In depth automation skills in JavaScript and Python
- API testing experience, manual and automated
- Familiarity with chatbot frameworks, LLMs and conversational testing
- Exposure to QA automation tools such as PyTest, Postman and dbt tests
- Strong analytical skills and attention to detail across data and agent behaviour
- Arabic speaker, this is essential given the team and the work
- Eligible to be employed full time in the UAE
- Nice to have: experience defining quality standards for generative AI in a regulated or high compliance environment
WHAT'S ON OFFER
- Salary around 30,000 AED per month, with flexibility for exceptional candidates
- The chance to own quality engineering for frontier AI products at a serious AI organisation
- Work at the edge of LLM and conversational AI testing, where the discipline is still being defined
- Hybrid working, 2 to 3 days onsite in Abu Dhabi
- Genuine influence over how responsible, reliable AI gets shipped
TO APPLY
Please apply via this advert or email [email protected] directly. For further information, call 0203 763 3888 or 07704 152 638. By applying, you consent to us processing and submitting your application (subject to suitability) for this vacancy only.
