Skip to content

Principal Software Engineer, B2B Engineering

385k – 490kSan Francisco, CAOnsite
Summary

Leads architecture and scaling of backend services, APIs, distributed systems, databases, and data pipelines for OpenAI's developer platform and enterprise products. Requires deep expertise in backend engineering, reliability, security, and cross-team collaboration in fast-paced environments.

About the role

Responsibilities

  • Design, build, and scale the backend services, APIs, and infrastructure that power OpenAI’s developer and enterprise products
  • Lead the architecture of distributed systems, databases, and data pipelines that support large-scale, high-reliability production workloads
  • Own major platform capabilities end-to-end, from early technical strategy and design through implementation, launch, and long-term operation
  • Shape the design of our APIs with care and intentionality, treating API interfaces as core product surfaces and driving a high-quality developer experience
  • Build secure, reliable, and compliant systems that meet the needs of both enterprise and developer use cases
  • Partner closely with product, research, design, infrastructure, and forward-deployed engineering teams to bring new capabilities into production
  • Drive technical direction across complex problem spaces, making sound architectural tradeoffs that balance speed, quality, and long-term maintainability
  • Improve engineering velocity by building internal tooling, platform abstractions, and systems that increase leverage across the broader organization
  • Raise the bar for engineering quality, system design, operational excellence, and technical decision-making across teams
  • Help identify and solve ambiguous, high-impact technical problems that cut across multiple systems and stakeholders

Requirements

  • Significant experience building, scaling, and evolving production backend systems in fast-moving environments
  • Deep expertise in software engineering fundamentals, distributed systems, and API design
  • Proficient in one or more backend languages such as Python, Go, Rust, or TypeScript
  • Track record of leading complex technical initiatives and driving architecture across teams or critical product areas
  • Care deeply about reliability, safety, security, and performance in production environments
  • Strong product instincts and a high bar for developer experience and interface design
  • Comfortable working in ambiguous, fast-moving environments and can create clarity where little exists
  • Own problems end-to-end and are eager to learn whatever is needed to solve them
  • Build thoughtfully, move with urgency, and collaborate effectively across disciplines
  • Influence technical direction through strong judgment, clear communication, and consistently high-quality execution
  • Experience as a founder or early engineer at a startup, or have built products and platforms from scratch
Skills
PythonGoRustTypeScriptDistributed SystemsAPIsDatabasesData PipelinesKubernetesDocker
Similar roles at this salary range
All Backend Engineering jobs →
Anthropic

Staff + Senior Software Engineer, Cloud Inference

The Cloud Inference team is seeking Staff/Senior Software Engineers to scale and optimize Claude across multiple cloud service providers. This role involves designing, building, and owning backend services and infrastructure, collaborating cross-functionally, and ensuring reliable and cost-effective inference management at massive scale.

320k – 485kSan Francisco, CABackend EngineeringHybridRustCI/CD
Thinking Machines Lab

Software Engineer, Platform, Tinker

Builds platform systems for AI fine-tuning API including billing, metering, authorization (RBAC/OAuth), organizations/teams, data exports, and audit logging. Requires backend proficiency in Python/Rust and experience in billing, access control, or multi-tenant systems; bachelor's or equivalent.

350k – 475kSan Francisco, CA +1Backend EngineeringOn-siteSSORust
OpenAI

Software Engineer, Foundations Retrieval

Software Engineer building and scaling retrieval infrastructure for AI models, including indexing, serving, and query execution systems. Partners with researchers to productionize embedding techniques and supports agentic workflows across OpenAI products.

380k – 555kSan Francisco, CABackend EngineeringOn-siteEmbeddingsML Systems
Anthropic

Staff+ Software Engineer, Backend

Staff backend engineer owns scalable systems for Anthropic's API, Claude.ai, and developer tools across teams like API Core and Enterprise Foundations. Requires 8+ years experience leading complex projects, distributed systems, and cross-team alignment in fast-paced AI environment.

405k – 485kSan Francisco, CA +2Backend EngineeringHybridGoAWS
Anthropic

Staff Software Engineer, Billing Platform

Builds and operates billing platform infrastructure to convert product usage into reliable revenue, focusing on pricing, payments, contracts, and data integrity. Requires 8+ years backend/platform experience, cross-functional collaboration with Finance/Product/Sales, and emphasis on correctness in financial systems.

320k – 405kSan Francisco, CA +1Backend EngineeringHybridCPQAPIs