# Senior Software Engineer, AI

**Company:** [August Health](https://hotfix.jobs/companies/august-health)
**Location:** Remote
**Role:** ML Engineering
**Experience:** 5+ years
**Skills:** TypeScript, Node.js, LLMs, Prompt Engineering, Agent Orchestration, Structured Output, Aws Bedrock, Claude, Evaluation Frameworks, Observability
**Posted:** 2026-06-05

> First dedicated AI engineer building and shipping LLM-powered features into a healthcare EHR platform. Own end-to-end delivery of production AI capabilities, establish evaluation and observability practices, and enable other product teams to adopt AI patterns.

## Job Description

## What You'll Do
- Design and ship LLM-powered product features end to end, including prompt and context design, structured output, tool/agent orchestration, and the UI/API work needed to land them in the product.
- Pair with product-vertical engineers to unblock AI feature work and help teams apply August Intelligence patterns in their own product areas.
- Turn repeated AI implementation work into reusable tools, examples, documentation, and lightweight practices that other teams can adopt.
- Build and extend our evaluation discipline so we can measure quality, catch regressions, and reason about nondeterministic behavior before customers feel it.
- Improve observability for AI workflows, including traces, prompt visibility, errors, latency, cost, and production feedback loops.
- Harden AI features for production: latency, cost, caching, pre-computation, timeouts, cancellation, memory behavior, and operational reliability.
- Handle PHI and sensitive resident data with care, including redaction, permissioning, tenancy boundaries, and safe access patterns.
- Partner with product managers and vertical engineering teams to translate clinical and operational workflows into AI capabilities.
- Help August learn where AI can make the product meaningfully more useful by prototyping, measuring, and refining ideas against real workflows.
- Help non-engineers experiment safely with real data while creating a clear path from prototype to production.
- Help drive responsible AI tool use inside engineering by modeling effective workflows, reviewing AI-assisted output, and raising shared standards without turning experimentation into ceremony.
- Review code, including AI-assisted code, with rigor and help set August Intelligence's engineering standards.

## About You
- 5+ years of experience building and shipping production software.
- Owned customer-facing features end to end and care about what happens after launch.
- Strong in production TypeScript, including typed Node services, testing, APIs, and clean data modeling.
- Hands-on applied-LLM experience: prompt design, structured output, tool or agent design, and practical reasoning about cost, latency, hallucination, and reliability tradeoffs.
- Bias toward the smallest useful thing: ship a walking skeleton, learn from it, and iterate rather than guessing future states and going big too early.
- Can explain exactly how your code works, including code an LLM helped you write.
- Enjoy pairing with other engineers, teaching through real work, and helping teams adopt new patterns without taking ownership away from them.
- Comfortable working with sensitive data and treat permissioning, privacy, and safety as table stakes.
- Communicate clearly in writing and conversation, especially when working with PMs, clinicians, operators, and engineers from other product areas.
- High agency and low ego. Like shaping ambiguous problems, not just implementing tickets.

## Nice to Have
- Experience with Mastra, the Vercel AI SDK, LangChain, LlamaIndex, or similar applied-LLM frameworks.
- Experience with eval or observability tooling for LLM systems, such as Phoenix/Arize, Langfuse, Helicone, or related tools.
- Experience helping an engineering team adopt AI tools, agentic coding workflows, or new development practices responsibly.
- Experience with functional TypeScript or Effect.
- Ability to read Scala or interest in learning enough Scala to navigate our backend.
- Healthcare, senior living, SOC 2, HIPAA, or other regulated-industry experience.
- Experience as an early engineer on a small, high-ownership team.

## Similar roles

- [Senior Machine Learning Engineer, Agent Oversight](https://hotfix.jobs/jobs/1f504a69-044f-47ab-872b-120a1706cd88) - Scale AI - San Francisco, CA - $216k – $270k/yr
- [Senior Software Engineer, Agent Oversight](https://hotfix.jobs/jobs/808ce719-6b16-4b6e-8887-8c8f8a780b75) - Scale AI - San Francisco, CA - $216k – $270k/yr
- [Senior Software Engineer, AI Infrastructure](https://hotfix.jobs/jobs/dd1c3420-6c0a-47ed-a1a7-de401bdf506c) - Ambient.ai - Redwood City, CA - $168k – $205k/yr
- [Senior Software Engineer](https://hotfix.jobs/jobs/423c60aa-ca4c-400d-babe-a50099433cbb) - SpotOn - Chicago, IL - $160k – $190k/yr
- [Senior AI Engineer, Enterprise](https://hotfix.jobs/jobs/87a30fd1-3fe6-47f3-a0a1-da444f3c00f4) - Snowflake - Menlo Park, CA - $156k – $224k/yr

**Apply:** https://hotfix.jobs/jobs/befb63d9-6f70-4afd-9e07-d773147a7a7c
**Canonical:** https://hotfix.jobs/jobs/befb63d9-6f70-4afd-9e07-d773147a7a7c