Machine Learning Lead (LLM)
Leads a team of senior data scientists developing and deploying LLM-based ML products, defining technical roadmaps, overseeing model training/inference pipelines, and translating outputs into actionable insights for civic applications. Requires 6+ years ML experience and 1+ years leading teams.
About the job
Responsibilities
- Lead a team of senior data scientists focused on fine-tuning large language models, conducting cutting-edge R&D, and building production inference systems.
- Collaborate with senior leadership to define the team roadmap and align priorities with organizational goals.
- Lead weekly meetings and standups, keeping the team unblocked and execution moving forward.
- Provide technical direction across projects using open-weight and off-the-shelf LLMs, as well as other advanced ML techniques.
- Oversee experimentation, optimization, and data quality to ensure models are accurate, reliable, and production-ready.
- Foster creative problem-solving and methodological rigor when challenges require custom solutions beyond standard ML approaches.
- Translate complex model outputs into actionable insights for stakeholders, ensuring technical work drives real-world impact.
Requirements
- 1+ years leading data science teams; 6+ years in ML or data engineering.
- Strong background in applied statistics, model selection, tuning, and evaluation.
- Proficient in Python, SQL, and modern ML frameworks (PyTorch, TensorFlow, or JAX).
- Experienced in building and deploying production ML and deep learning pipelines.
- Familiar with LLMs, embeddings, agentic workflows, and RAG systems.
- Comfortable with cloud and DevOps tools (Docker, Kubernetes, Terraform).
- Skilled in exploratory data analysis and handling imperfect real-world data.
Compensation
- Salary: $165,000 - $210,000 annually, commensurate with experience
- Competitive medical, dental, and health coverage
Skills
Python, SQL, PyTorch, TensorFlow, JAX, LLMs, Embeddings, RAG, Docker, Kubernetes, Terraform
Similar jobs
ML Engineering jobs
Lightning AI
New York, NYBuild and optimize large language model training and post-training pipelines, improving model quality, distributed performance, evaluation, and production readiness. The role requires deep PyTorch and transformer experience, strong distributed-systems and software-engineering skills, and expertise in modern LLM optimization techniques.
Upstart
United States
Build and operate backend infrastructure for machine learning model training, serving, feature management, and marketplace simulation. The role requires 6+ years of software engineering experience, distributed systems expertise, and experience with production ML platforms.
Parallel Systems
Los Angeles, CA
Develop and deploy real-time perception and sensor-fusion software for autonomous battery-electric rail vehicles. The role requires strong robotics, geometry-based computer vision, C/C++ and Rust experience, plus hands-on work with multimodal sensors and production systems.
LangChain
New York, NY
Leads hands-on development and deployment of production AI agents and workflows, sets technical standards, and mentors engineers. Requires 4+ years of software engineering experience, production LLM application experience, and strong Python or TypeScript skills.
LegitScript
United States
Owns the full lifecycle of data and ML solutions, from ingestion and feature-ready datasets through production deployment and business-impact measurement. The role combines data engineering, applied machine learning, MLOps, and generative AI to build risk detection capabilities.