# Senior Software Engineer, RL Environments

**Company:** [Pareto AI](https://hotfix.jobs/companies/pareto-ai)
**Location:** San Francisco, CA
**Role:** Fullstack Engineering
**Salary:** $245k – $300k/yr
**Experience:** 7+ years
**Skills:** Python, TypeScript, Docker, Containers, AWS, Cloud Infrastructure, Managed Databases, CI/CD, Mcp, Reinforcement Learning, Functional Programming, Incident Response, Production Systems, Grader Design, Coding Agents
**Posted:** 2026-08-20

> Owns reinforcement learning environments end to end, from scoping research goals and building reproducible containerized tools and graders through deployment and production operations. Requires 7+ years of production engineering experience, strong Python or TypeScript skills, cloud and container expertise, and close stakeholder collaboration.

## Job Description

## Responsibilities
- Build and own reinforcement learning environments and MCP tools for post-training loops at frontier labs.
- Scope research goals with lab requesters and translate them into buildable specifications.
- Build container images, tools, graders, and delivery workflows; ship environments into customer platforms.
- Investigate failed tasks and jobs, lead incident response, and maintain production health.
- Improve platform leverage through automated image builds, release notes, spec-first design, CI gates, and review harnesses.
- Surface platform gaps and contribute them to the product roadmap.

## Requirements
- **7+ years** building production systems.
- Production experience with **Python** or **TypeScript**; strong functional-language experience is also relevant.
- Experience building and shipping containerized services, including Docker layering, dependency pinning, and reproducible images.
- Experience owning production systems, investigating incidents to root cause, and documenting preventive fixes.
- Familiarity with cloud infrastructure, containers, managed databases, and deployment workflows on AWS or another major cloud.
- Based in the United States and able to get to the Bay Area as needed.
- Comfortable working directly with research stakeholders, evolving specifications, and coding agents while reviewing their output.

## Compensation and Benefits
- Base salary: **$245,000–$300,000**, plus equity.
- Equity is included at every level.
- Final offer depends on experience and level; level-specific ranges are shared early in the process.

## Similar jobs

- [Software Engineer](https://hotfix.jobs/jobs/391f4036-81fb-418d-bbc6-92ce18512563) - Clay - New York, NY - $240k – $300k/yr
- [Senior Software Engineer](https://hotfix.jobs/jobs/9c270f10-066a-48e9-903a-b222396b1598) - Garner Health - New York, NY - $230k – $285k/yr
- [Senior Software Engineer, Caper AI](https://hotfix.jobs/jobs/c2972989-f970-4fa4-ab34-1495960cdaab) - Instacart - Remote - $230k – $255k/yr
- [Senior Software Engineer, Identity Graph](https://hotfix.jobs/jobs/5538b4ba-50ab-41e6-9a40-9fa1723a23aa) - Baselayer - San Francisco, CA - $230k – $340k/yr
- [Software Engineer, Native Learning Experiences](https://hotfix.jobs/jobs/786a1bb4-5e8f-4747-a61d-9a4330ecb404) - OpenAI - San Francisco, CA - $266k – $385k/yr

**Apply:** https://hotfix.jobs/jobs/bfbc5d64-3deb-4dc0-ab12-40b32f556e6c
**Canonical:** https://hotfix.jobs/jobs/bfbc5d64-3deb-4dc0-ab12-40b32f556e6c