AI Quality Automation Engineer

About the Role We are looking for an AI Quality & Automation Engineer to join our team focused on testing and optimizing Generative AI, conversational AI, and RAG applications. This role involves ensuring production-ready AI systems through quality testing, benchmarking, safety validation, and automation. Key Responsibilities • Test Generative AI and conversational systems • Perform LLM evaluation and benchmark testing • Validate RAG (retrieval quality, relevance, grounding) • Build automation frameworks using Playwright/Selenium • Conduct API, regression, and E2E testing • Perform AI safety, red teaming, and bias validation • Support observability, monitoring, and HITL workflows • Collaborate with engineering, QA, and DevOps teams • Support CI/CD quality pipelines Requirements • Extensive hands-on automation expertise • QA & automation testing experience • Playwright/Selenium and API testing (Postman, REST) skills • GenAI & RAG validation, LLM evaluation knowledge • Prompt engineering and conversational AI testing experience • HITL testing, AI safety & observability understanding • SQL, Git, Python, and CI/CD concepts proficiency