Skip to content
OtterOtter

Staff Machine Learning Engineer

Lead architect and builder of large-scale ASR/NLP/LLM systems for Otter's conversational intelligence products. Owns end-to-end ML lifecycles from research to production deployment, mentoring engineers and setting technical direction.

About the job

Your Impact

  • Architect, build, and evolve large-scale SID / ASR / NLP / LLM systems that power mission-critical product experiences including summarization, chat, and speech understanding across millions of conversations.
  • Lead the design and implementation of training, fine-tuning, post-training, and inference strategies for large language and speech models using PyTorch and/or JAX, making principled trade-offs across quality, latency, cost, and reliability.
  • Design and improve model architectures, loss functions, decoding strategies, and training techniques for speech and language models, informed by both research and production constraints.
  • Own end-to-end ML system lifecycles, from research prototyping through production deployment, monitoring, iteration, and long-term maintenance.
  • Partner deeply with product, and infrastructure teams to develop and translate cutting-edge research into scalable, production-grade systems that deliver measurable user and business impact.
  • Drive system-level improvements in model performance, robustness, observability, and operational excellence using real-world conversational data at scale.
  • Set technical direction and best practices for ML infrastructure, data pipelines, evaluation frameworks, and deployment workflows in a cloud environment.
  • Identify and resolve complex, ambiguous problems in model behavior, data quality, scaling, and system interactions, often before they surface as user-visible issues.
  • Mentor and elevate other engineers, influencing team standards, reviewing designs, and contributing to a culture of strong technical decision-making and execution.
  • Influence applied research and technical roadmaps by identifying promising speech and multimodal modeling approaches, and driving their validation and adoption into production systems.

We're Looking for Someone Who

  • Holds a Bachelor’s or Master’s degree in Computer Science or a related field with 10+ years of relevant industry experience; PhD is preferred.
  • Has deep, hands-on experience building and fine-tuning large language or foundation models, with production experience in ASR, TTS, multimodal, or modern LLM/NLP systems, and a strong understanding of model failure modes and trade-offs.
  • Demonstrates strong command of modern ML research, with the ability to critically evaluate new papers and drive innovation by identifying what is production-worthy versus experimental.
  • Has extensive experience deploying, scaling, monitoring, and operating ML systems in production across training, inference, and serving infrastructure, including model versioning, rollback strategies, and performance regression detection while balancing cost, latency, and reliability constraints.
  • Is comfortable working with large-scale speech and conversational datasets, including data preprocessing, augmentation, quality analysis, and labeling strategies to support model training and evaluation.
  • Is highly effective at cross-functional collaboration, working end-to-end with product, infra, research, and data teams to deliver outcomes, not just models.
  • Can lead technical projects independently, driving clarity in ambiguous problem spaces and making sound architectural decisions.
  • Has experience with or strong interest in agentic systems, tool-use frameworks, or multi-model orchestration.
  • Has demonstrated ability to influence beyond their immediate team, shaping technical direction, standards, or long-term strategy.
  • Experience with personalization, recommendation systems, or user modeling is a plus.

Skills

PyTorch, JAX, Asr, NLP, LLMs, Sid, Tts, Machine Learning, Model Training, Fine-Tuning, Inference, Model Deployment, Speech Models, Multimodal Models

Square

Square

San Francisco, CA

Staff Machine Learning Engineer, Fraud & Abuse
$277k+/yrRemote12+ YOEML Engineering

Build and operate production machine learning systems for ranking, retrieval, recommendations, personalization, and customer intelligence. The role requires 12+ years of production software and ML experience, strong expertise in intelligent systems, and sound judgment around trustworthy customer-impacting signals.

Reddit

Reddit

United States

Senior Staff Machine Learning Engineer, Feed Relevance
$266k+/yrRemote10+ YOEML Engineering

Leads the technical direction and development of large-scale, GenAI-powered recommendation and feed-ranking systems. Requires 10+ years of industry experience in relevance-driven products, deep expertise in machine learning and recommendations, and strong organizational influence and mentoring skills.

Reddit

Reddit

United States

Senior Staff Machine Learning Systems Engineer, Ads ML Platform
$293k+/yrRemote8+ YOEML Engineering

Leads technical strategy for Reddit’s Ads ML Platform, improving feature development, training-data generation, experimentation, and the path to production ML serving. The role requires 8+ years in infrastructure or distributed systems, production ML platform experience, and strong cross-team technical leadership.

Garner Health

Garner Health

New York, NY

Staff Machine Learning Operations Engineer
$298k+/yrHybrid7+ YOEML Engineering

Leads the reliability, architecture, deployment automation, and monitoring of production machine learning systems. Requires 7+ years of software engineering experience, deep MLOps platform expertise, and strong Kubernetes, cloud, infrastructure-as-code, and observability fundamentals.

Garner Health

Garner Health

New York, NY

Staff Applied Scientist
$300k+/yrHybrid7+ YOEML Engineering

Leads end-to-end development of production algorithmic systems for healthcare, spanning machine learning, optimization, and LLM applications. The player-coach role requires 6+ years of industry experience, strong problem-solving and metrics judgment, and technical leadership of a small team.