Skip to content

Staff Software Engineer (AI)

Develops LLM/NLU systems and data pipelines to process medical records, classify patients, and recommend care levels for a healthcare AI platform. Requires 5+ years backend/data engineering experience with production LLMs and integration into user-facing features.

180k – 250kSan Francisco, CAML EngineeringHybrid5+ YOE

About the role

Responsibilities

  • Develop LLM/NLU systems to process and extract meaningful information from clinical notes and medical documents, classify patients according to level-of-care guidelines, and make accurate recommendations.
  • Establish best practices for LLM/AI systems, benchmarking/evaluation frameworks, and model governance to improve reliability, maintainability, and scalability.
  • Build data pipelines that scale efficiently while maintaining strict data privacy and security standards.
  • Collaborate with backend engineers to integrate AI/ML capabilities seamlessly into the Onos platform.

Requirements

  • 5+ years experience building and deploying applications in production in a backend engineering / data engineering capacity.
  • Relevant experience with developing LLM-based systems for ingesting and evaluating unstructured records for industry-specific use cases and integrating them with user-facing features.
  • Deep understanding of the limitations of using LLMs and the best practices for using them for reliable, consistent, and accurate outputs.
  • Customer obsessed and motivated to build a best-in-class model for behavioral health clinical assessments in the healthcare space.
  • A collaborative team player with a focus on delivering measurable results.

Nice-to-Haves

  • Specifically worked with medical records to evaluate whether a patient’s history meets criteria for evaluations or assessments (e.g., claims authorization or other types of evaluations).
  • Experience wearing multiple hats as a generalist backend engineer.
  • Experience working with data pipelines and Python and related data science/ML libraries.
  • Significant experience working with healthcare data and with HIPAA best practices.
  • Knowledge of modern LLM and ML infrastructure and MLOps best practices.

Tech Stack

Infrastructure/Systems: AWS (ECS, Bedrock, Cognito, etc.), Docker, Github Actions Languages/Frameworks: Python, Django, Celery, django-ninja, django-tenants Database/Storage: PostgreSQL (AWS RDS), S3 Development Tools: Github, Jira, Coderabbit, Tusk, Claude

Benefits

  • Flexible hybrid arrangement: 2-3 days/week at San Francisco office (Financial District), remote-first culture.
  • Unlimited vacation policy.
  • Paid parental leave.
  • Medical, dental, and vision insurance.
  • Pre-tax commuter benefits.
  • 401(k).
  • Significant equity as an early employee.
  • Direct mentorship from experienced founders.
  • Ground-floor opportunity to help build a team and culture.
  • Regular team events and offsites.
  • Company-provided equipment and home office setup.

Skills

PythonDjangoLLMsAWSPostgresDockerCeleryS3MLOpsHIPAA

Similar roles

ML Engineering jobs

Member of Technical Staff - X Search

Develops and operates large-scale search engine infrastructure, including retrieval algorithms, indexing, and ML ranking models integrated with Grok AI. Requires experience with search systems, vector databases, and production ML in Python, Go, or Rust.

180k – 440kPalo Alto, CAML EngineeringOn-siteGoRust

Member of Technical Staff - Post-Training and RL

Develops advanced post-training and reinforcement learning techniques like RLHF/DPO and reward modeling to enhance AI model reasoning, truthfulness, and real-world capabilities at xAI. Seeks passionate AI enthusiasts obsessed with truth-seeking models; prior experience preferred but not required.

180k – 600kPalo Alto, CAML EngineeringOn-siteDpoJAX

Member of Technical Staff - Multimodal Understanding

Develops large-scale distributed systems and pipelines for multimodal AI pre-training, post-training, and inference across image, video, audio, and text. Requires expert Python proficiency, experience with JAX/PyTorch/XLA, and scaling multimodal ML systems.

180k – 440kPalo Alto, CAML EngineeringOn-siteRlJAX

Staff Data Scientist | Modeling

Staff Data Scientist advances ML models for healthcare claims auditing, curating data, developing precise models, and optimizing business impact for health plans. Requires expertise in SQL, Python/R, and building ML models from scratch.

180k – 260kUnited StatesML EngineeringRemoteRSQL

Staff Software Engineer | GenAI & Agentic Workflows

Leads design and development of large-scale AI systems for document processing and agentic workflows in healthcare payment integrity. Requires 6+ years experience with Java/Python, productionizing LLMs/RAG, and distributed systems.

180k – 250kUnited StatesML EngineeringRemote6+ YOERAGRay