Staff+ Software Engineer, ML Inference Path

Responsibilities

• Design and build scalable ML infrastructure for real-time safety deployments across classifier and model ecosystems.
• Build monitoring and observability tools for classifier performance, data quality, and system health.
• Collaborate with research teams to productionize safety research and translate experimental techniques into robust, scalable systems.
• Optimize inference latency and throughput for real-time safety evaluations while maintaining reliability.
• Implement automated testing, deployment, and rollback systems for production ML models.
• Partner with Safeguards, Security, and Alignment teams to deliver infrastructure meeting safety and production requirements.
• Develop internal tools and frameworks that accelerate safety research and deployment.

Requirements

• Proficiency in Python and experience with ML frameworks such as PyTorch, TensorFlow, or JAX.
• Understanding of distributed systems principles and experience building high-throughput, low-latency systems.
• Experience building automated or self-service deployment pipelines and evaluation infrastructure for independent researcher rollouts.
• Experience implementing A/B testing frameworks and experimentation infrastructure for ML systems.
• Results-oriented approach with a focus on reliability and impact in safety-critical systems.
• Strong collaboration skills and interest in translating research into production systems.
• Care about AI safety and its societal impacts.
• Bachelor’s degree or equivalent combination of education, training, and experience in a relevant field.

Nice-to-haves

• 5+ years of experience building production ML infrastructure, ideally in safety-critical domains such as fraud detection, content moderation, or risk assessment.
• Experience with large language models and modern transformer architectures.
• Experience developing monitoring and alerting systems for ML model performance and data drift.
• Experience in trust and safety, fraud prevention, or content moderation.
• Knowledge of privacy-preserving ML techniques and compliance requirements.

Compensation

• Annual salary: $320,000–$485,000 USD.