QA Engineer, Integrations and AI Agents

Responsibilities

• Own feature validation: Build test plans and validate new features from requirements through production release.
• Test integrations and APIs: Verify authentication, API behavior, permissions, webhooks, retries, pagination, rate limits, error handling, and third-party dependencies.
• Validate end-to-end workflows: Test complete customer journeys across the dashboard, SDKs, APIs, connectors, and agent workflows.
• Perform exploratory testing: Find edge cases, unexpected interactions, and usability issues that are not covered by standard test cases.
• Maintain regression coverage: Build and execute reliable regression suites for high-risk and frequently used product areas.
• Test AI-native experiences: Evaluate tool-calling agents and other non-deterministic workflows where outputs may vary between executions.
• Improve automation: Automate repeatable API, integration, and UI test cases where automation creates meaningful release confidence.
• Investigate production issues: Reproduce customer-reported problems using logs, network traces, API responses, and production signals.
• Drive defects to resolution: Write clear bug reports with reproduction steps, evidence, impact, severity, and expected behavior. Verify fixes and prevent regressions.
• Strengthen release quality: Partner with engineers and product managers to identify risks, define acceptance criteria, and make informed release decisions.

Requirements

• Strong hands-on experience testing modern web applications, APIs, or developer products.
• Excellent exploratory testing and debugging skills.
• Ability to turn product requirements into structured test plans and high-value test cases.
• Experience with functional, integration, API, end-to-end, and regression testing.
• Strong understanding of defect severity, prioritization, release risk, and quality signoff.
• Experience testing REST APIs using tools such as Postman, Bruno, Insomnia, or equivalent.
• Ability to reason about authentication, permissions, retries, webhooks, pagination, rate limits, asynchronous workflows, and eventual consistency.
• Comfort using browser developer tools, logs, API payloads, and network traces to investigate failures.
• Working knowledge of SQL and the ability to validate data when debugging an issue.
• Ability to write or maintain automated tests using JavaScript, TypeScript, Python, or a similar language.
• Familiarity with tools such as Playwright, Cypress, pytest, or equivalent frameworks.
• Understanding of CI/CD pipelines, automated quality gates, flaky-test management, and regression coverage.
• Take ownership of quality problems and drive them through resolution.
• Write precise, reproducible bug reports and communicate risk clearly.
• Work independently in an ambiguous, fast-moving startup environment.
• Collaborate effectively with engineers, product managers, support teams, and other stakeholders.
• Consistently available and responsive during Pacific Time working hours.

Nice-to-Haves

• Experience testing developer tools, SDKs, workflow automation products, or integration platforms.
• Experience with OAuth, API keys, webhooks, and third-party application integrations.
• Familiarity with AI agents, LLM evaluation, MCP, or tool-calling systems.
• Experience testing across multiple browsers, devices, and operating systems.
• Exposure to observability tools and production incident investigation.
• Experience establishing QA practices or improving quality processes at an early-stage company.