# Senior Applied AI Engineer

**Company:** [Function Health](https://hotfix.jobs/companies/function-health)
**Location:** Remote
**Role:** ML Engineering
**Experience:** 7+ years
**Skills:** Python, Go, LangGraph, Pydanticai, Dspy, Llamaindex, FastAPI, Flask, Postgres, Pgvector, Pinecone, Weaviate, Milvus, OpenTelemetry, Kubernetes
**Posted:** 2026-06-10

> Build and operate production multi-agent AI systems that turn longitudinal health data into actionable clinical recommendations. Requires 6+ years building production ML or backend systems plus 1+ years building agentic AI.

## Job Description

## Key Responsibilities
- Architect and build stateful, graph-based agent workflows with tool use, planning, and memory
- Integrate LLMs and multimodal models via structured I/O (JSON Schema, Pydantic validators) and function/tool calling
- Build high-reliability APIs and streaming services for real-time inference, speech, and vision
- Own production readiness: tracing, logging, metrics, rate limiting, circuit breakers, and SLOs
- Stand up eval pipelines: offline golden sets, LLM-as-judge with human rubrics, online A/B, and regression tests in CI
- Implement retrieval and memory: hybrid search, vector and graph retrieval, semantic caches, and long-horizon context
- Optimize cost/latency: model routing, prompt and tool selection, quantization, and KV cache/prefill strategies
- Partner cross-functionally to translate research into robust production systems and iterate quickly behind evaluation gates
- Mentor engineers through design docs and architecture decisions

## Requirements
- 1+ years building agentic AI systems; 6+ years as a full-stack or ML engineer, building production backends or ML systems in Python, Go, or similar
- Fluency with agentic orchestration (e.g., LangGraph, PydanticAI, DSPy, LlamaIndex) and tool/function calling
- Experience integrating frontier LLMs and multimodal models via managed APIs or self-hosted serving
- Strong with API design and backend frameworks (FastAPI, Flask) and event-driven architectures
- Data systems expertise with PostgreSQL, including token streaming and throughput tuning
- Retrieval and memory: vector databases (pgvector, Pinecone, Weaviate, Milvus), hybrid search, and graph/knowledge storage
- Production evals: LLM-as-judge, human-in-the-loop, rubric design, and CI-integrated regression tests
- Observability and SRE: OpenTelemetry traces, metrics, structured logs, SLOs, dashboards, and on-call triage
- Cloud-native delivery: Kubernetes, Terraform, Docker, GPU scheduling/autoscaling on AWS or GCP
- CI/CD proficiency with GitHub Actions and test automation for prompts, tools, and agents
- Clear, concise communication and high ownership in fast-paced environments

## Nice to Haves
- Real-time multimodal systems: streaming ASR, low-latency TTS, WebRTC, and vision pipelines
- RAG expertise beyond basics: Graph RAG, multi-hop retrieval, sub-agents, query planning, and freshness policies
- Safety and governance: policy-as-code, red-teaming, PII handling, audit logs, and role-based tool authorization
- Regulated data experience (HIPAA, SOC 2, GDPR) and data residency controls
- Personalization at inference time, long-term memory agents, session state, and episodic memory stores
- Experience with consumer-scale AI apps, high-traffic systems, or on-device/edge acceleration (WebGPU)

## Similar roles

- [Senior Machine Learning Engineer, Agent Oversight](https://hotfix.jobs/jobs/1f504a69-044f-47ab-872b-120a1706cd88) - Scale AI - San Francisco, CA - $216k – $270k/yr
- [Senior Software Engineer, Agent Oversight](https://hotfix.jobs/jobs/808ce719-6b16-4b6e-8887-8c8f8a780b75) - Scale AI - San Francisco, CA - $216k – $270k/yr
- [Senior Software Engineer, AI Infrastructure](https://hotfix.jobs/jobs/dd1c3420-6c0a-47ed-a1a7-de401bdf506c) - Ambient.ai - Redwood City, CA - $168k – $205k/yr
- [Senior Software Engineer](https://hotfix.jobs/jobs/423c60aa-ca4c-400d-babe-a50099433cbb) - SpotOn - Chicago, IL - $160k – $190k/yr
- [Senior AI Engineer, Enterprise](https://hotfix.jobs/jobs/87a30fd1-3fe6-47f3-a0a1-da444f3c00f4) - Snowflake - Menlo Park, CA - $156k – $224k/yr

**Apply:** https://hotfix.jobs/jobs/b9a01b6c-efc2-4004-8939-3430277a72bd
**Canonical:** https://hotfix.jobs/jobs/b9a01b6c-efc2-4004-8939-3430277a72bd