Staff+ Software Engineer, RL Data Platform
Staff-level full-stack engineer building feedback interfaces, backend services, and data pipelines that supply reinforcement-learning training data. The role requires production TypeScript/React and Python experience, strong project ownership, and collaboration with RL researchers.
About the job
Responsibilities
- Design, build, and operate feedback and data-collection interfaces for human annotators, domain experts, and internal researchers.
- Build and maintain backend services, APIs, and pipelines that route model samples to humans and return structured feedback for training.
- Own the reliability, latency, and usability of systems operating continuously against live model endpoints.
- Partner with RL researchers to translate evolving data needs into collection campaigns and supporting tooling.
- Build dashboards, monitoring, and inspection tools for data quality and throughput.
- Identify and remove bottlenecks between data requests and inclusion in the training mix.
Requirements
- Strong full-stack engineering skills with production experience in TypeScript, React, and Python.
- Experience designing and operating backend services and data pipelines used by other teams.
- Demonstrated ownership of projects from ambiguous brief through production.
- Ability to work directly with technical stakeholders and make sound prioritization decisions.
- Effective use of AI tools in day-to-day engineering work.
- Bachelor’s degree or equivalent combination of education, training, and experience in a relevant field.
Nice-to-haves
- Experience building annotation, labeling, evaluation, or other human-in-the-loop data tools.
- Experience with RLHF, preference data, or human-feedback pipelines for machine-learning systems.
- Experience shipping researcher-facing or expert-facing internal tools and improving their usability.
- Experience running experiments on data-collection interfaces to improve data quality.
- Experience working with crowdworker or expert vendor platforms at scale.
- Familiarity with LLM training and evaluation.
Compensation
- Annual salary: $320,000–$405,000 USD.
Skills
TypeScript, React, Python, Backend Services, APIs, Data Pipelines, Machine Learning, RLHF, LLMs, Monitoring
Similar jobs
Fullstack Engineering jobs
Anthropic
San Francisco, CABuild and own Anthropic’s AI-native education platform, including backend infrastructure, adaptive learning systems, credentialing, integrations, and enterprise readiness. The role requires strong full-stack skills with backend depth and at least seven years of software engineering experience.
Zoox
Foster City, CA
Leads architecture and delivery for Geofencer, a safety-critical geospatial platform spanning interactive map editing, backend services, release pipelines, and fleet integrations. Requires 10+ years of full-stack experience, strong Python and React/TypeScript skills, and demonstrated technical leadership.
VSCO
San Francisco, CA
Owns VSCO’s production GPU image-processing engine and leads its integration into Studio Pro across iOS and macOS. The role requires 10+ years of engineering experience, deep rendering and mobile graphics expertise, strong systems programming skills, and a track record of technical leadership and mentorship.
Valon
New York, NYBuild scalable software and infrastructure for a highly regulated mortgage-servicing platform, collaborating with Product and Design to deliver customer-focused solutions. The role requires 7+ years of software engineering experience and expertise in scalable systems, applications, or infrastructure.
Greptile
San Francisco, CA
Build and lead development of complex AI-enabled code intelligence features, shared infrastructure, and full product capabilities. The role requires a bachelor’s degree, 6+ years of software or DevOps engineering experience, JavaScript or TypeScript expertise, and in-person collaboration.