QA Engineer
Owns end-to-end quality for AI coding products by designing comprehensive tests, reproducing complex defects, and improving QA automation and release processes. The role requires 5+ years of QA or test engineering experience, coding ability, strong debugging skills, and comfort evaluating non-deterministic AI behavior.
About the job
Responsibilities
- Own end-to-end product quality across AI workflows, including onboarding flows, chat interactions, multi-file edits, agentic task execution, and autonomous workflows.
- Design and execute functional, regression, integration, exploratory, and end-to-end test plans across product surfaces and releases.
- Break down complex flows into testable scenarios, identifying edge cases, race conditions, state-recovery failures, and real-world usage patterns.
- Reproduce, document, and debug issues across layers, distinguishing UI defects, orchestration or system issues, and unexpected AI behavior.
- Partner with engineering and product to define completion criteria, set quality standards, and ensure releases meet developer expectations.
- Establish QA playbooks, test processes, and automation where it provides leverage.
- Help evolve CI/CD and testing practices as the product scales.
Requirements
- 5+ years of QA or test engineering experience testing complex product workflows, including multi-step user journeys, cross-surface interactions, and end-to-end behavior.
- Deep expertise in functional, regression, exploratory, integration, and end-to-end testing methodologies.
- Ability to read and write code in Python, TypeScript, or a similar language; navigate codebases and reason about systems.
- User-first testing approach focused on real-world usage rather than only specifications.
- Exceptional attention to detail and strong debugging instincts.
- Ability to communicate clearly and precisely in bug reports and triage.
- Familiarity with CI/CD and test automation frameworks.
- Comfort working in fast-moving, release-driven environments.
- Schedule flexibility, including overlap with US time zones and occasional weekend availability for release cycles.
Nice-to-haves
- Experience testing AI-powered products with non-deterministic outputs.
- Experience testing IDE plugins or extensions, CLIs, or code review systems.
- Familiarity with AI coding tools such as Windsurf, Copilot, Cursor, or Devin.
- Prior software engineering experience with shipped production code.
Skills
Python, TypeScript, CI/CD, Test Automation, Functional Testing, Regression Testing, Exploratory Testing, Integration Testing, End-To-End Testing, Debugging, Ide Extensions, Cli Tools, Ai Coding Tools
Similar jobs
QA Engineering jobs
Q4 Inc
Pune, India
Quality Specialist responsible for software quality engineering across test design, automation, CI/CD, production monitoring, and AI-powered testing of LLM-backed and agentic features. Requires 5+ years of QA experience and familiarity with Java, Python or JavaScript, Selenium, Agile, and test management tools.
MongoDB
Gurugram, India
Build testing and verification frameworks for application and database modernization, including functional equivalence, performance validation, data integrity, and LLM-assisted unit-test generation. The role requires 4+ years of software development experience, JVM expertise, and experience with testing frameworks, databases, and LLM evaluation.
Origin
Bengaluru, India
Owns verification and validation of mechanical subsystems and complete autonomous robot assemblies from prototype through production. The role requires hands-on mechanical testing, inspection, failure analysis, GD&T expertise, and collaboration across design, manufacturing, suppliers, and deployment teams.
Fortanix
Bengaluru, India
The SDET will build and maintain automated test frameworks, execute functional and performance testing, integrate quality checks into CI/CD pipelines, and improve product reliability. The role requires a bachelor's degree and at least five years of SDET or comparable experience, with strong programming and automation skills.
Circle
Remote
Senior Quality Engineer partnering across product teams to assess risk, build web and API test automation, investigate technical failures, and improve quality practices. Requires strong Playwright and TypeScript experience, exploratory testing skills, CI/CD knowledge, and the ability to debug application code.