Staff Software Engineer - Test Systems & Tooling
Leads development of shared test systems and tooling that reproduce production workloads, validate failure modes, and expand system-level coverage. Requires strong software engineering fundamentals, technical leadership, and experience with production-quality platforms or distributed systems.
About the job
Responsibilities
- Build production-like test environments and tooling for test cells that resemble production topology, configuration, and behavior.
- Develop workload-generation capabilities for multi-tenant, stress, load, and traffic-replay testing.
- Create repeatable failure-mode testing tools for latency, dependency faults, resource exhaustion, degraded-state recovery, and regional failures.
- Identify high-impact system-level testing gaps and implement repeatable continuous or release validation coverage.
- Build shared libraries, test harnesses, frameworks, and paved paths for system and integration testing.
- Mentor engineers and influence testing strategy through design documents, code reviews, and cross-team collaboration.
- Partner with Cloud/Infrastructure, Reliability, Release Engineering, and product teams to incorporate incident learnings into pre-production coverage and release pipelines.
Requirements
- Strong software engineering fundamentals and experience building and operating production-quality platforms, infrastructure, developer tooling, or distributed systems.
- Demonstrated technical leadership of ambiguous, cross-team initiatives, including alignment and delivery of durable shared systems.
- Experience designing for observability, debuggability, and operational readiness, including metrics, logs, tracing, safe rollouts, and failure analysis.
- Ability to collaborate across organizational boundaries.
- Strong written communication skills for design documents, testing strategy proposals, and scalable documentation.
Nice-to-Haves
- Chaos engineering, fault injection, workload replay or shadowing, performance testing, or multi-tenant test strategy.
- Experience building broadly used internal platforms, self-service environments, paved roads, or shared frameworks.
- Familiarity with engineering and system outcome metrics, including signal quality, coverage gaps, incident-to-coverage time, and adoption.
Compensation and Benefits
- Estimated pay range: $212,000–$278,250 depending on experience and location.
- Eligible to participate in Temporal's equity plan.
- Full-time benefits include unlimited paid time off, holidays, medical, dental and vision coverage, disability and life insurance, a 401(k) plan, learning and development support, lifestyle spending, home office setup, professional memberships, work-from-home meals, internet stipend, and wellness resources.
- Occasional travel may be required for company events, team offsites, and other in-person collaboration.
Skills
Distributed Systems, Test Automation, Chaos Engineering, Fault Injection, Load Testing, Performance Testing, Traffic Replay, Observability, Tracing, Workload Generation, Multi-Tenant Testing, Release Pipelines
Similar jobs
QA Engineering jobsOwn validation, optimization, and debugging of wireless firmware and TCU connectivity across cellular, Wi-Fi, Bluetooth, and embedded systems. The role requires 10+ years of wireless validation or embedded test engineering experience, deep 3GPP protocol knowledge, network-emulation expertise, and Python or Shell automation skills.
Leads manufacturing, supplier, and site quality programs for datacenter infrastructure, from vendor qualification through deployment. Requires 10+ years of quality, supplier, process improvement, or datacenter operations experience and a bachelor’s degree or equivalent experience.
The Staff Engineer will own automated testing, performance validation, and quality engineering for a multi-cloud micro-segmentation platform. The role requires extensive automation experience with distributed SaaS systems, cloud networking, CI/CD, and resilient large-scale testing.
Own and evolve a scale and reliability platform, diagnosing distributed-system performance issues, improving observability, and automating cloud-based testing. The role requires staff-level infrastructure or SRE experience, strong Python skills, Kubernetes expertise, and hands-on performance troubleshooting.
Staff Quality Assurance Engineer who will build and own organization-wide automated testing strategy, frameworks, observability, and AI-assisted workflows. The role requires deep quality engineering experience across testing layers, strong AWS and Node.js/TypeScript skills, and the ability to coach teams toward measurable quality ownership.