Responsibilities
- Develop LLM/NLU systems to process and extract meaningful information from clinical notes and medical documents, classify patients according to level-of-care guidelines, and make accurate recommendations.
- Establish best practices for LLM/AI systems, benchmarking/evaluation frameworks, and model governance to improve reliability, maintainability, and scalability.
- Build data pipelines that scale efficiently while maintaining strict data privacy and security standards.
- Collaborate with backend engineers to integrate AI/ML capabilities seamlessly into the Onos platform.
Requirements
- 5+ years experience building and deploying applications in production in a backend engineering / data engineering capacity.
- Relevant experience with developing LLM-based systems for ingesting and evaluating unstructured records for industry-specific use cases and integrating them with user-facing features.
- Deep understanding of the limitations of using LLMs and the best practices for using them for reliable, consistent, and accurate outputs.
- Customer obsessed and motivated to build a best-in-class model for behavioral health clinical assessments in the healthcare space.
- A collaborative team player with a focus on delivering measurable results.
Nice-to-Haves
- Specifically worked with medical records to evaluate whether a patient’s history meets criteria for evaluations or assessments (e.g., claims authorization or other types of evaluations).
- Experience wearing multiple hats as a generalist backend engineer.
- Experience working with data pipelines and Python and related data science/ML libraries.
- Significant experience working with healthcare data and with HIPAA best practices.
- Knowledge of modern LLM and ML infrastructure and MLOps best practices.
Tech Stack
Infrastructure/Systems: AWS (ECS, Bedrock, Cognito, etc.), Docker, Github Actions
Languages/Frameworks: Python, Django, Celery, django-ninja, django-tenants
Database/Storage: PostgreSQL (AWS RDS), S3
Development Tools: Github, Jira, Coderabbit, Tusk, Claude
Benefits
- Flexible hybrid arrangement: 2-3 days/week at San Francisco office (Financial District), remote-first culture.
- Unlimited vacation policy.
- Paid parental leave.
- Medical, dental, and vision insurance.
- Pre-tax commuter benefits.
- 401(k).
- Significant equity as an early employee.
- Direct mentorship from experienced founders.
- Ground-floor opportunity to help build a team and culture.
- Regular team events and offsites.
- Company-provided equipment and home office setup.