Senior Software Engineer, RL Environments
Owns reinforcement learning environments end to end, from scoping research goals and building reproducible containerized tools and graders through deployment and production operations. Requires 7+ years of production engineering experience, strong Python or TypeScript skills, cloud and container expertise, and close stakeholder collaboration.
About the job
Responsibilities
- Build and own reinforcement learning environments and MCP tools for post-training loops at frontier labs.
- Scope research goals with lab requesters and translate them into buildable specifications.
- Build container images, tools, graders, and delivery workflows; ship environments into customer platforms.
- Investigate failed tasks and jobs, lead incident response, and maintain production health.
- Improve platform leverage through automated image builds, release notes, spec-first design, CI gates, and review harnesses.
- Surface platform gaps and contribute them to the product roadmap.
Requirements
- 7+ years building production systems.
- Production experience with Python or TypeScript; strong functional-language experience is also relevant.
- Experience building and shipping containerized services, including Docker layering, dependency pinning, and reproducible images.
- Experience owning production systems, investigating incidents to root cause, and documenting preventive fixes.
- Familiarity with cloud infrastructure, containers, managed databases, and deployment workflows on AWS or another major cloud.
- Based in the United States and able to get to the Bay Area as needed.
- Comfortable working directly with research stakeholders, evolving specifications, and coding agents while reviewing their output.
Compensation and Benefits
- Base salary: $245,000–$300,000, plus equity.
- Equity is included at every level.
- Final offer depends on experience and level; level-specific ranges are shared early in the process.
Skills
Python, TypeScript, Docker, Containers, AWS, Cloud Infrastructure, Managed Databases, CI/CD, Mcp, Reinforcement Learning, Functional Programming, Incident Response, Production Systems, Grader Design, Coding Agents
Similar jobs
Fullstack Engineering jobs
Clay
New York, NYTechnical software engineering leader who sets strategy, delivers complex cross-functional projects, shapes architecture, and elevates engineering teams through mentoring and technical influence. The role spans product, platform, AI, security, and developer-experience domains.
Garner Health
New York, NY
Senior Software Engineer leading technical strategy, building AI-assisted systems, mentoring engineers, and solving large-scale healthcare data problems. Requires at least four years of software engineering experience, strong generalist skills, and familiarity with security and HIPAA compliance.
Instacart
United States
Senior software engineer designing full-stack applications, AI systems, data pipelines, and distributed backend infrastructure for connected retail technologies. Requires a bachelor’s degree and at least five years of relevant software engineering experience.
Baselayer
San Francisco, CA
Senior engineer owning end-to-end identity-graph product features, including data ingestion, entity resolution, Postgres schemas, customer APIs, multi-tenancy, and performance. Requires strong async Python, deep Postgres expertise, FastAPI experience, and production ownership.
OpenAI
San Francisco, CA
Build OpenAI’s native learning experiences as a hands-on, staff-level full-stack product engineer. You will lead 0-to-1 development across frontend, backend, learner state, experimentation, and evaluation while shaping adaptive AI learning products for workplace users.