Software Development Engineer In Test III - AI
Designs and maintains automated test strategies for AI-powered products, validating LLM integrations and RAG pipelines while improving coverage and release quality. The role requires 5+ years in QA/SDET, strong automation and API testing skills, independent ownership, and mentorship capabilities.
About the job
Responsibilities
- Design, develop, and maintain automation frameworks and test strategies for AI products.
- Test and validate AI-powered features, including OpenAI, Claude, and other AI integrations.
- Evaluate and improve Retrieval-Augmented Generation (RAG) flows for accuracy and performance.
- Leverage AI automation tools to optimize test coverage and efficiency.
- Collaborate with developers, product managers, and AI researchers to ensure high-quality releases.
- Own tasks end-to-end and work independently to deliver on commitments.
- Mentor and guide junior SDETs, fostering a culture of quality and continuous learning.
Requirements
- 5+ years of overall experience in QA/SDET roles.
- Proven experience working with AI tools such as OpenAI, Claude, or similar large language model platforms.
- Strong understanding of testing AI/ML products and their unique challenges.
- Hands-on knowledge of RAG pipelines and testing methodologies.
- Proficiency in automation frameworks such as Playwright, Cypress, Selenium, or similar.
- Experience with API testing using Postman, REST, GraphQL, or gRPC.
- Strong problem-solving skills and the ability to work independently.
- Mentorship and leadership skills for guiding peers or junior engineers.
Nice to Have
- Experience with CI/CD pipelines and cloud platforms such as AWS, Google Cloud, or Azure.
- Familiarity with MLOps pipelines and monitoring AI systems.
- Exposure to performance and scalability testing of AI workloads.
Skills
OpenAI, Claude, Ai/Ml Testing, RAG, Playwright, Cypress, Selenium, Postman, Rest, GraphQL, gRPC, CI/CD, AWS, GCP, MLOps
Similar jobs
QA Engineering jobs
Q4 Inc
Pune, India
Quality Specialist responsible for software quality engineering across test design, automation, CI/CD, production monitoring, and AI-powered testing of LLM-backed and agentic features. Requires 5+ years of QA experience and familiarity with Java, Python or JavaScript, Selenium, Agile, and test management tools.
MongoDB
Gurugram, India
Build testing and verification frameworks for application and database modernization, including functional equivalence, performance validation, data integrity, and LLM-assisted unit-test generation. The role requires 4+ years of software development experience, JVM expertise, and experience with testing frameworks, databases, and LLM evaluation.
Origin
Bengaluru, India
Owns verification and validation of mechanical subsystems and complete autonomous robot assemblies from prototype through production. The role requires hands-on mechanical testing, inspection, failure analysis, GD&T expertise, and collaboration across design, manufacturing, suppliers, and deployment teams.
Fortanix
Bengaluru, India
The SDET will build and maintain automated test frameworks, execute functional and performance testing, integrate quality checks into CI/CD pipelines, and improve product reliability. The role requires a bachelor's degree and at least five years of SDET or comparable experience, with strong programming and automation skills.
Circle
Remote
Senior Quality Engineer partnering across product teams to assess risk, build web and API test automation, investigate technical failures, and improve quality practices. Requires strong Playwright and TypeScript experience, exploratory testing skills, CI/CD knowledge, and the ability to debug application code.