# Backend Software Engineer (Evals)

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Role:** Backend Engineering
**Salary:** $230k – $385k/yr
**Experience:** 4+ years
**Skills:** Python, FastAPI, Postgres, Distributed Systems, APIs, Data Processing Pipelines, Llm Evals, AI Agents, Multi-Agent Workflows, Ml Models
**Posted:** 2025-12-23

> Build evals infrastructure and backend services for OpenAI's support automation, focusing on reliable pipelines, monitoring, and AI model integration. Requires 4+ years backend experience with Python, FastAPI, Postgres, and ML/LLM evals.

## Job Description

## In this role, you will:
- Design eval pipelines that are reliable, reproducible, and extendable
- Build infrastructure for continuous eval monitoring frameworks (regression/drift monitoring, robust golden datasets) with feedback loops
- Design, build, and maintain backend services and APIs for intelligent automation and knowledge systems
- Integrate and structure data across internal platforms for downstream systems and AI workflows
- Collaborate with data, research, and engineering teams to integrate OpenAI models into workflows
- Own the full development lifecycle of new backend systems
- Build with scale and maintainability in mind while iterating rapidly

## You might be a great fit if you have:
- 4+ years of backend engineering experience at product-driven companies (excluding internships)
- Proficiency in backend technologies: Python, FastAPI, Postgres
- Experience designing and scaling distributed systems, APIs, or data processing pipelines
- Experience building AI agents or applications, including evals and performance improvement via prompting or scaffolding
- Familiarity with LLM evaluation methods and patterns like multi-agent workflows, tool use, or long context
- Experience creating production evals and/or measuring ML/LLM model performance at scale
- Pragmatic mindset for iterative shipping toward long-term vision

## Similar roles

- [Software Engineer, Codex -Enterprise Controls](https://hotfix.jobs/jobs/9fc148ac-afcb-4558-a41e-a772e8869a71) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer, Private Computing](https://hotfix.jobs/jobs/61850697-3157-406e-8968-ea0a1b8753cd) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer, Enterprise AI Platform](https://hotfix.jobs/jobs/487f3501-620e-4e9d-abf9-8c3e9c0d2034) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer, Codex Core Agents](https://hotfix.jobs/jobs/64559708-d350-4d5b-a023-0f3df0ab5cbd) - OpenAI - San Francisco, CA - $230k – $325k/yr
- [Software Engineer, Ads Monetization, Revenue Platform](https://hotfix.jobs/jobs/d23d02c1-1938-4b30-82a7-aa252a3f8154) - OpenAI - San Francisco, CA - $230k – $385k/yr

**Apply:** https://hotfix.jobs/jobs/f422d5eb-31fb-4632-a7b3-a92c9e5d66d4
**Canonical:** https://hotfix.jobs/jobs/f422d5eb-31fb-4632-a7b3-a92c9e5d66d4