Skip to content
Onos HealthOnos HealthSan Francisco, CA

Staff Software Engineer (AI)

Develops LLM/NLU systems and data pipelines to process medical records, classify patients, and recommend care levels for a healthcare AI platform. Requires 5+ years backend/data engineering experience with production LLMs and integration into user-facing features.

180k – 250k/yr
Hybrid5+ YOEML Engineering

About the role

Responsibilities

  • Develop LLM/NLU systems to process and extract meaningful information from clinical notes and medical documents, classify patients according to level-of-care guidelines, and make accurate recommendations.
  • Establish best practices for LLM/AI systems, benchmarking/evaluation frameworks, and model governance to improve reliability, maintainability, and scalability.
  • Build data pipelines that scale efficiently while maintaining strict data privacy and security standards.
  • Collaborate with backend engineers to integrate AI/ML capabilities seamlessly into the Onos platform.

Requirements

  • 5+ years experience building and deploying applications in production in a backend engineering / data engineering capacity.
  • Relevant experience with developing LLM-based systems for ingesting and evaluating unstructured records for industry-specific use cases and integrating them with user-facing features.
  • Deep understanding of the limitations of using LLMs and the best practices for using them for reliable, consistent, and accurate outputs.
  • Customer obsessed and motivated to build a best-in-class model for behavioral health clinical assessments in the healthcare space.
  • A collaborative team player with a focus on delivering measurable results.

Nice-to-Haves

  • Specifically worked with medical records to evaluate whether a patient’s history meets criteria for evaluations or assessments (e.g., claims authorization or other types of evaluations).
  • Experience wearing multiple hats as a generalist backend engineer.
  • Experience working with data pipelines and Python and related data science/ML libraries.
  • Significant experience working with healthcare data and with HIPAA best practices.
  • Knowledge of modern LLM and ML infrastructure and MLOps best practices.

Tech Stack

Infrastructure/Systems: AWS (ECS, Bedrock, Cognito, etc.), Docker, Github Actions Languages/Frameworks: Python, Django, Celery, django-ninja, django-tenants Database/Storage: PostgreSQL (AWS RDS), S3 Development Tools: Github, Jira, Coderabbit, Tusk, Claude

Benefits

  • Flexible hybrid arrangement: 2-3 days/week at San Francisco office (Financial District), remote-first culture.
  • Unlimited vacation policy.
  • Paid parental leave.
  • Medical, dental, and vision insurance.
  • Pre-tax commuter benefits.
  • 401(k).
  • Significant equity as an early employee.
  • Direct mentorship from experienced founders.
  • Ground-floor opportunity to help build a team and culture.
  • Regular team events and offsites.
  • Company-provided equipment and home office setup.

Skills

PythonDjangoLLMsAWSPostgresDockerCeleryS3MLOpsHIPAA

Similar roles

ML Engineering jobs
xAI

Member of Technical Staff

xAIPalo Alto, CA

Build and optimize the RL training framework and infrastructure for large-scale workloads at SpaceXAI, from ablations to production runs. Requires experience with distributed systems and proficiency in Python, JAX, Rust, or C++.

180k – 440k/yr
On-site5+ YOEML Engineering
LlamaIndex

Member of Technical Staff, Applied Research

LlamaIndexSan Francisco, CA

Build and productionize vision-language models for document understanding at LlamaIndex. Focus on training, fine-tuning, synthetic data, benchmarking, and turning research prototypes into accurate, low-latency production systems for real-world PDFs, tables, and enterprise docs. Requires 3+ years ML engineering/applied research experience with strong PyTorch skills.

180k – 250k/yr
Hybrid3+ YOEML Engineering
xAI

Member of Technical Staff, Inference

xAIPalo Alto, CA

Build and optimize the high-performance inference platform serving Grok at massive scale. Design distributed serving infrastructure, low-level GPU optimizations, quantization, speculative decoding, and CI/CD for production reliability and low latency.

180k – 440k/yr
On-site5+ YOEML Engineering
Black Forest Labs

Member of Technical Staff

Black Forest LabsSan Francisco, CA

Research Engineer embedded in large-scale multimodal model training at Black Forest Labs (creators of FLUX). Own performance, stability, and low-precision optimizations for production training runs; profile, debug distributed systems, implement GPU kernels, and partner with researchers to ship frontier generative models.

180k – 290k/yr
Hybrid7+ YOEML Engineering
xAI

Member of Technical Staff - X Search

xAIPalo Alto, CA

Develops and operates large-scale search engine infrastructure, including retrieval algorithms, indexing, and ML ranking models integrated with Grok AI. Requires experience with search systems, vector databases, and production ML in Python, Go, or Rust.

180k – 440k/yr
On-siteML Engineering