⚡ Caught by QAWatcher · 12h ago
Automation QA Engineer
📍 Remote· SENIOR
About the Role
We are seeking an experienced Automation QA Engineer to lead the development and maintenance of robust automation frameworks. This role focuses on ensuring the quality of innovative AI applications through comprehensive testing.
Key Responsibilities
• Build and maintain enterprise automation frameworks
• Perform API, UI, integration, and AI system testing
• Implement AI evaluation and release validation pipelines
• Conduct security and adversarial testing for AI applications
• Collaborate with engineering teams to ensure application quality
Requirements
• Strong expertise in Python, Playwright, and TypeScript
• Experience with API Testing and Automation Framework Development
• Knowledge of Testing LLM-based and Agentic AI applications
• Familiarity with Statistical Assertions, Semantic Scoring, and AI Evaluation
• Experience with GitHub Actions CI/CD pipelines
• Understanding of Asynchronous and Event-driven System Testing
• Experience with SQL and Synthetic Data Pipelines
• Knowledge of OWASP LLM Top 10 and Prompt Injection Testing
• Familiarity with OpenTelemetry, Langfuse, and qTest
Preferred Certifications
• ISTQB Test Automation Certification
PythonPlaywrightTypeScriptAPI TestingAutomation Framework DevelopmentTesting LLM-based and Agentic AI applicationsStatistical AssertionsSemantic Scoring
Apply to this role →Application drafted for you · sent only when you click Send
Your watcher also caught recently