Skip to content
OpenAIOpenAI

Systems Test Engineer, End-to-End Validation | Consumer Devices

Designs and executes end-to-end validation for consumer devices spanning hardware, software, connectivity, cloud services, and accessories. The role emphasizes reproducible test procedures, failure diagnosis, test-environment development, and automation of high-value scenarios.

About the job

Responsibilities

  • Design end-to-end test coverage and reproducible procedures for user journeys, realistic usage patterns, edge cases, degraded conditions, and failure scenarios across devices, services, connectivity, and accessories.
  • Build and operate test environments involving devices, servers, networks, accounts, peripherals, accessories, and controlled environmental conditions.
  • Prepare devices and environments for release validation, execute test campaigns, track results, and communicate risks and blocking issues.
  • Reproduce complex failures, isolate contributing components, collect logs and telemetry, and provide clear reproduction steps and supporting evidence.
  • Identify repeatable manual workflows suitable for automation and develop or partner on tooling for device control, setup, measurement, data collection, and test execution.
  • Convert field issues, production failures, and discovered bugs into repeatable regression tests and maintain coverage across product releases.
  • Collaborate with embedded, systems, cloud, hardware, QA, and product teams to improve testability and close validation gaps.

Requirements

  • Experience with system-level, integration, end-to-end, or validation testing for complex hardware-software products.
  • Ability to translate loosely defined product behavior into clear, repeatable, measurable test procedures.
  • Experience testing systems spanning devices, networks, backend services, mobile applications, or connected accessories.
  • Hands-on debugging and methodical failure isolation across hardware, firmware, software, connectivity, and cloud services.
  • Comfort with logs, diagnostics, command-line tools, network tools, and device configuration utilities.
  • Experience automating tests or test setups using Python or similar scripting tools.
  • Understanding of reliable test environments, including setup, configuration, preconditions, expected results, and recovery procedures.
  • Ability to work across engineering disciplines and communicate complex failures with clear evidence and reproducible steps.

Compensation

  • Annual salary: $230,000–$290,000.
  • Hybrid work model with four days per week in the office.
  • Relocation assistance offered to new employees.

Skills

System Testing, Integration Testing, End-To-End Testing, Hardware-In-The-Loop, Python, Command-Line Tools, Network Tools, Diagnostics, Telemetry, Test Automation, Regression Testing, Cloud Services, Mobile Applications, Device Configuration

OpenAI

OpenAI

San Francisco, CA

Systems Integration Manager | Consumer Devices
$290k+/yrOn-site5+ YOEQA Engineering

Leads the systems integration organization responsible for device validation infrastructure, test automation, developer tooling, and lab operations for consumer hardware products. The role combines technical architecture, release quality ownership, team development, and cross-functional hardware-software validation.

Baseten

Baseten

San Francisco, CA
Software Engineer - Testing Frameworks
$165k+/yrHybrid5+ YOEQA Engineering

Build and own the testing frameworks, integration environments, performance tooling, and resilience capabilities that enable reliable AI inference infrastructure. The role requires strong Go or Python skills, distributed-systems testing experience, Kubernetes and Docker expertise, and the ability to improve test reliability at scale.

Discord

Discord

San Francisco, CA

QA/DevOps Engineer
$156k+/yrOn-site3+ YOEQA Engineering

Owns automated QA suite development and maintenance for Oracle ERP Cloud and Salesforce, integrating Tosca-based regression testing into CI/CD pipelines and quarterly release cycles. Requires 3–5+ years of QA automation experience, Tosca expertise, enterprise ERP testing, and scripting or pipeline skills.

OnePay

OnePay

United States

QE Platform Engineer
$150k+/yrRemote5+ YOEQA Engineering

Build and scale shared test automation frameworks and execution infrastructure for web, mobile, and backend systems. The role requires 5+ years in test automation or platform engineering, strong TypeScript/Node.js skills, and experience with Kubernetes, AWS, and cross-stack testing.

Deepgram

Deepgram

United States

Software Test Engineer
$150k+/yrRemote5+ YOEQA Engineering

Build automated and exploratory testing systems for products, APIs, AI models, and data platforms. The role requires 5+ years of software or QA engineering experience, strong scripting skills, and the ability to evaluate metrics, reliability, and model behavior.