Senior Machine Learning Engineer
Build and operate production ML and AI services using Python, LLM APIs, and robust software engineering practices. The role requires 6+ years of professional software experience, including production ML systems, and partners closely with product and engineering teams.
About the job
Responsibilities
- Build, deploy, and maintain production ML and AI services, including model code, APIs, monitoring, and tests.
- Use LLM APIs such as OpenAI and Anthropic in production systems, balancing cost, latency, and quality.
- Write clean, well-structured production software with appropriate abstractions, error handling, testing, and CI/CD.
- Partner with product and engineering teams to translate business problems into ML solutions and define API contracts.
- Build evaluation frameworks, run experiments, and make data-driven decisions about model and system performance.
- Automate pipelines, build agentic workflows, and contribute reusable skills and context to an agentic platform.
Requirements
- Bachelor’s or master’s degree in Computer Science, Mathematics, or a related technical field, or equivalent experience.
- 6+ years of professional software development experience, including at least 2 years building ML systems in production.
- Strong Python skills and experience writing clean, testable, object-oriented code.
- Production experience with LLM APIs, prompt engineering, structured outputs, function calling, cost management, and evaluation.
- Experience building and maintaining APIs, working with CI/CD pipelines, and shipping code used by other engineers.
- Experience or comfort with AI-assisted workflows, LLMs, code-generation tools, or agentic systems.
Nice to Have
- Experience with MLOps platforms such as MLflow, SageMaker, or Vertex.
- Background in document processing, OCR, or information extraction.
- Experience with PySpark or large-scale data processing.
- Ruby experience.
- Familiarity with compliance-sensitive domains such as fintech, legal tech, or HR tech.
- Working knowledge of dbt, Snowflake, or modern ELT and data transformation tools.
Compensation and Benefits
- Annual on-target earnings or base salary: $207,000–$244,000 USD.
- Competitive cash and equity compensation.
- Learning and development allowance.
- Medical, dental, and vision coverage.
- Up to $25,000 reimbursement for fertility, adoption, and parental planning services.
- Flexible paid time off.
- Monthly wellness stipend.
Skills
Python, LLM APIs, Prompt Engineering, API Development, CI/CD, MLOps, MLflow, Amazon Sagemaker, Google Vertex Ai, Ocr, Pyspark, Ruby, dbt, Snowflake, OpenAI
Similar jobs
ML Engineering jobs
Front
San Francisco, CA
Build and deploy generative AI and LLM-powered agentic applications at Front to automate customer support inquiries, enhance product capabilities, and drive operational insights. Requires 5+ years software engineering experience with strong production AI/ML focus, agentic/RAG expertise, and proficiency in Node.js, TS, and Python.
Fetch
United States
Build and operate low-latency machine learning systems for ad ranking, relevance, and optimization, including feature pipelines, experimentation, evaluation, and production inference. The role requires 6+ years of software engineering experience, strong Python skills, AWS experience, and practical LLM application experience.
Instacart
United StatesDevelop and deploy production machine learning models for real-time inventory and shelf-stocking intelligence at scale. The role requires 5+ years of production ML experience, strong Python and ML framework skills, cloud and data pipeline expertise, and a bachelor's degree or equivalent experience.
6sense
San Francisco, CA
Owns end-to-end production machine learning systems, including NLP, LLM, agentic, ranking, and recommendation capabilities. Requires 8+ years of industry experience, strong Python and cloud ML expertise, and the ability to deliver explainable AI products with cross-functional and customer impact.
Traba
New York, NYBuild and deploy production AI-agent systems, including their harnesses, evaluations, orchestration, and supporting services. The role requires 5+ years of software engineering experience, production LLM or agent experience, and strong Python or TypeScript/Node.js skills.