Skip to content
Hike MedicalHike MedicalSan Francisco, CA

Senior Machine Learning Engineer, Multimodal AI

Build and productionize multimodal AI systems that turn unstructured healthcare documents, faxes, and transcripts into reliable structured data and automated workflows using LLMs, OCR, and voice AI.

170k – 300k/yr
On-site5+ YOEML Engineering

About the role

What You’ll Work On

  • Build and improve multimodal AI pipelines that process healthcare documents, OCR output, transcripts, and workflow context into structured facts and decisions.
  • Design LLM-powered extraction, classification, validation, and routing systems for operational and clinical workflows.
  • Improve document intelligence systems across OCR, schema extraction, confidence scoring, error handling, and low-quality input recovery.
  • Develop voice AI workflows for patient and provider outreach, transcript understanding, post-call extraction, and follow-up automation.
  • Create evaluation harnesses, benchmarks, and regression tests for extraction quality, hallucination prevention, workflow accuracy, and model changes.
  • Decide when to use LLMs, deterministic logic, retrieval, human review, or hybrid systems to maximize quality and reliability.
  • Partner with product and engineering to identify the highest-leverage automation opportunities and translate them into shipped systems.
  • Optimize cost, latency, and reliability across model providers and infrastructure layers.
  • Work closely with backend engineers to deploy AI systems into our AWS and serverless environment with strong observability and operational rigor.

Technical Requirements

  • Strong experience building production AI systems around LLMs, OCR, and unstructured data workflows.
  • Proven track record shipping applied AI products, not just prototyping models offline.
  • Deep familiarity with modern LLM workflows including prompting, structured outputs, tool use, retries, fallbacks, guardrails, and model evaluation.
  • Experience with document intelligence systems such as OCR pipelines, document extraction, classification, post-processing, and confidence-based review flows.
  • Experience with voice or conversational AI, or adjacent systems involving transcripts, call automation, and conversational extraction.
  • Strong proficiency in Python and comfort working in production codebases with APIs, queues, and backend services.
  • Experience deploying and operating AI systems in AWS or similar cloud environments, including serverless or event-driven architectures.
  • Strong instincts around evaluation, benchmarking, monitoring, and quality assurance for real-world AI systems.
  • Ability to work across structured and unstructured data and design systems that are robust to noisy, incomplete, and ambiguous inputs.

Nice to Have

  • Experience in healthcare, claims, revenue cycle, or regulated operational environments.
  • Experience with human-in-the-loop workflow design and review tooling.
  • Familiarity with telephony vendors, speech systems, or conversational agent infrastructure.
  • Experience comparing and routing across model providers such as OpenAI, Anthropic, Bedrock, or equivalent.
  • Experience designing internal tools or operational systems used directly by workflow teams.
  • Background in machine learning, applied NLP, information extraction, or related fields.

Skills

PythonLLMsOcrAWSDocument IntelligenceVoice AiPrompt EngineeringModel EvaluationServerlessStructured Outputs

Similar roles

ML Engineering jobs
Talkiatry

Senior AI Engineer

TalkiatryUnited States

Build full-stack AI systems including agentic workflows, RAG pipelines, and production infrastructure for mental healthcare applications. Requires 2+ years software engineering experience and 1+ year with LLMs or agentic AI.

170k – 195k/yr
Remote2+ YOEML Engineering
Metropolis

Senior AI Engineer

MetropolisSeattle, WA +2

Designs, builds, and maintains LLM-based AI systems, data pipelines, and automation tools to transform business processes. Requires 6+ years software engineering with 2+ years AI/LLM production experience, strong Python, and data engineering skills.

170k – 200k/yr
On-site6+ YOEML Engineering
Skydio

Senior Autonomy Engineer - Deep Learning

SkydioSan Mateo, CA

Develops real-time deep learning models for drone autonomy, focusing on detection, tracking, segmentation, and optical flow using visual data. Requires hands-on experience with deep neural networks, computer vision, Python/C++, and model optimization for embedded hardware.

170k – 278k/yr
HybridML Engineering
Ambient.ai

Senior Software Engineer, AI Infrastructure

Ambient.aiRedwood City, CA

Build and optimize scalable AI infrastructure for real-time inference, evaluation, and continuous improvement of LLMs, LVMs, computer vision, and multimodal models on large-scale video data. Requires 4+ years production ML systems experience, strong Python skills, and expertise in inference optimization and model serving.

168k – 205k/yr
Hybrid4+ YOEML Engineering
Chime

Senior AI/ML Engineer

ChimeChicago, IL +3

Senior AI/ML Engineer building transformer and deep learning models on financial and behavioral data to power personalized growth and marketing experiences at Chime. Requires strong production ML experience with PyTorch, AWS, and large-scale data infrastructure.

172k – 238k/yr
Hybrid5+ YOEML Engineering