Skip to content

Machine Learning Lead (LLM)

Leads a team of senior data scientists developing and deploying LLM-based ML products, defining technical roadmaps, overseeing model training/inference pipelines, and translating outputs into actionable insights for civic applications. Requires 6+ years ML experience and 1+ years leading teams.

165k – 210kUnited StatesML EngineeringRemote6+ YOE

About the role

Responsibilities

  • Lead a team of senior data scientists focused on fine-tuning large language models, conducting cutting-edge R&D, and building production inference systems.
  • Collaborate with senior leadership to define the team roadmap and align priorities with organizational goals.
  • Lead weekly meetings and standups, keeping the team unblocked and execution moving forward.
  • Provide technical direction across projects using open-weight and off-the-shelf LLMs, as well as other advanced ML techniques.
  • Oversee experimentation, optimization, and data quality to ensure models are accurate, reliable, and production-ready.
  • Foster creative problem-solving and methodological rigor when challenges require custom solutions beyond standard ML approaches.
  • Translate complex model outputs into actionable insights for stakeholders, ensuring technical work drives real-world impact.

Requirements

  • 1+ years leading data science teams; 6+ years in ML or data engineering.
  • Strong background in applied statistics, model selection, tuning, and evaluation.
  • Proficient in Python, SQL, and modern ML frameworks (PyTorch, TensorFlow, or JAX).
  • Experienced in building and deploying production ML and deep learning pipelines.
  • Familiar with LLMs, embeddings, agentic workflows, and RAG systems.
  • Comfortable with cloud and DevOps tools (Docker, Kubernetes, Terraform).
  • Skilled in exploratory data analysis and handling imperfect real-world data.

Compensation

  • Salary: $165,000 - $210,000 annually, commensurate with experience
  • Competitive medical, dental, and health coverage

Skills

PythonSQLPyTorchTensorFlowJAXLLMsEmbeddingsRAGDockerKubernetesTerraform

Similar roles

ML Engineering jobs

Senior GenAI Software Engineer

Senior engineer building and shipping production-grade GenAI systems for ad creative generation, including multimodal models and interactive playables. Requires 5+ years experience, strong Python/JS skills, and proven LLM production experience.

165k – 230kUnited StatesML EngineeringRemote5+ YOELLMsHTML

Senior AI Engineer

Builds and productionizes LLM-powered agent workflows, focusing on orchestration, evaluation, reliability, safety controls, and product iteration. Requires strong agentic systems expertise and engineering skills for scalable AI systems.

165k – 250kNew York, NYML EngineeringOn-siteLLMsMemory

Senior Machine Learning Engineer

Build and productionize large-scale recommendation systems, NLP/embedding models, and agentic AI workflows. Requires 6+ years ML/NLP experience and expertise in PyTorch/TensorFlow, RAG, and vector search.

165k – 259kUnited StatesML EngineeringRemote6+ YOERAGLora

Senior Software Engineer, Model Serving

Designs and builds scalable infrastructure for high-throughput, low-latency AI/ML model serving on CPU/GPU. Requires 5+ years in distributed systems, inference expertise, and strong system design skills.

166k – 225kSan Francisco, CAML EngineeringOn-site5+ YOEGPURouting

Senior Machine Learning Engineer - GenAI Platform

Build customer-facing generative AI platform covering ML lifecycle from data generation to agent-building. Requires 4+ years experience in distributed systems and ML platforms, with strong product ownership.

166k – 225kSan Francisco, CAML EngineeringOn-site4+ YOEGoC++