AI Quality & Automation Engineer

About the Role We are looking for an experienced AI Quality & Automation Engineer with strong hands-on expertise in QA Automation and Generative AI Testing. Key Responsibilities • Design and implement QA automation frameworks for AI systems • Perform API testing using tools like Postman and REST APIs • Conduct Generative AI & LLM Testing • Validate RAG systems and evaluate LLM performance • Test Prompt Engineering and Conversational AI • Utilize Python, SQL, Git, and CI/CD for automation • Perform End-to-End, Regression & Automation Testing Requirements • 10+ years of experience in QA Automation • Strong expertise in Playwright / Selenium • Experience with API Testing (Postman, REST APIs) • Knowledge of Generative AI & LLM Testing • Understanding of RAG Validation & LLM Evaluation • Skills in Prompt Engineering & Conversational AI Testing • Proficiency in Python, SQL, Git, and CI/CD • Experience with End-to-End, Regression & Automation Testing Preferred Skills • Experience with OpenAI / Azure OpenAI / ChatGPT / Claude • Familiarity with LangChain, CrewAI, LangGraph, MCP • Knowledge of Pinecone, ChromaDB, Weaviate • Experience with RAGAS, DeepEval • Skills in Docker, Kubernetes, GitHub Actions • Healthcare / Insurance Domain Experience