# Software Quality Engineer

**Company:** [Writer](https://hotfix.jobs/companies/writer)
**Location:** San Francisco, CA, New York, NY, Seattle, WA
**Role:** QA Engineering
**Salary:** $132k – $258k/yr
**Experience:** 5+ years
**Skills:** Python, TypeScript, Playwright, AWS, Azure, GCP, Docker, Kubernetes, CI/CD
**Posted:** 2026-05-28

> As a Software Quality Engineer, you will define and implement QA strategies for AI agents and LLM-powered applications, ensuring reliability and performance. This role involves developing automation frameworks, collaborating with engineering teams, and driving continuous improvement in testing processes.

## Job Description

## About the role
Are you passionate about ensuring the highest quality for cutting-edge generative AI applications? As a software quality engineer at WRITER, you'll play a critical role in shaping the reliability, performance, and trustworthiness of our AI-powered work orchestration platform. You’ll be at the forefront of defining and implementing rigorous quality strategies for our enterprise-grade LLMs and AI agents, directly impacting how hundreds of global companies unlock transformational value through AI. This is a unique chance to dive deep into the unique challenges of AI quality assurance and make a tangible difference in a rapidly evolving field.

This is a hybrid role based out of our London, San Francisco, Seattle, and New York City hubs. You will report directly to the director of engineering.

## What you'll do
* Define and implement comprehensive quality assurance strategies and test plans for our AI agents and LLM-powered applications, ensuring exceptional product reliability and performance.
* Designing and developing automation frameworks: creating robust, scalable, and maintainable automated test frameworks from scratch or enhancing existing ones. You’ll need proficiency in at least one language like Typsecript, Python.
* Collaborate closely with product managers, machine learning engineers, and data scientists to understand complex AI features and model behaviors, translating them into effective test cases and validation criteria.
* Drive the continuous improvement of our testing processes and infrastructure, integrating automated checks within our CI/CD pipelines to ensure rapid, high-quality releases.
* Identify, document, and track software defects and inconsistencies, performing root cause analysis to provide actionable feedback to development teams.
* Monitor production systems and AI model performance, proactively identifying potential issues and contributing to post-release quality validation.
* Champion quality best practices across engineering teams, fostering a culture of ownership and continuous improvement in delivering world-class AI solutions.
* Designing, managing, and maintaining test data strategies and mock services to ensure stable, isolated, and repeatable test execution.
* Experience designing, developing, or integrating agentic AI systems, AI skills, and the Model Context Protocol (MCP).
* Manage the full defect lifecycle by analyzing customer feedback and debugging logs to identify, prioritize, and track software bugs, collaborating closely with development teams to ensure timely resolution.

## What you need
* 5+ years of hands-on experience in software quality assurance or engineering, with a strong focus on testing complex distributed systems or AI/ML applications.
* Proficiency in programming languages like Python or Typescript for test automation, and experience with modern testing frameworks such as Playwright.
* Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and the unique challenges of testing generative AI outputs.
* Experience with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) in a CI/CD environment is a big plus.
* Exceptional analytical skills to dissect complex problems and a keen eye for detail, ensuring no bug goes unnoticed.
* A collaborative spirit that helps you Connect cross-functional teams to common quality goals, Challenge existing assumptions to build better systems, and Own the end-to-end quality of our products.
* Demonstrated ability to drive initiatives independently and thrive in a fast-paced, evolving startup environment.

## Benefits & perks (US Full-time employees)
* Generous PTO, plus company holidays
* Medical, dental, and vision coverage for you and your family
* Paid parental leave for all parents (16 weeks)
* Fertility and family planning support
* Early-detection cancer testing through Galleri
* Flexible spending account and dependent FSA options
* Health savings account for eligible plans with company contribution
* Annual work-life stipends for:
* Wellness stipend for gym, massage/chiropractor, personal training, etc.
* Learning and development stipend
* Company-wide off-sites and team off-sites
* Competitive compensation, company stock options and 401k

## Similar roles

- [Salesforce Quality Engineer](https://hotfix.jobs/jobs/40cb8ff3-5cac-44cd-bffc-0b7267fe9af9) - Vanta - Remote - $128k – $151k/yr
- [Software Development Engineer in Test, Platform Safety Assurance](https://hotfix.jobs/jobs/851145db-43b8-4c68-ad10-d8c688f6e235) - Zoox - Foster City, CA - $138k – $212k/yr
- [V&V Test Engineer](https://hotfix.jobs/jobs/ed4f04eb-3cfa-494c-a7a8-d5e7ba5a29e3) - Applied Intuition - Sunnyvale, CA - $126k – $147k/yr
- [Software Engineer II – Test/Internal Tooling](https://hotfix.jobs/jobs/d2afc6df-36ae-4cf3-950a-46fbe9fe5a67) - Parallel Systems - Los Angeles, CA - $140k – $164k/yr
- [QA Engineer - Core Database (remote)](https://hotfix.jobs/jobs/4e4dad48-44d8-43d2-a1b3-d900a1ae2d60) - Clickhouse - Remote - $141k – $230k/yr

**Apply:** https://hotfix.jobs/jobs/13c6aecb-2c6e-4b6c-8f26-502586c01107
**Canonical:** https://hotfix.jobs/jobs/13c6aecb-2c6e-4b6c-8f26-502586c01107