# Senior Full Stack AI Engineer (Rapid Prototyping & Analytics )

**Company:** [Prompt Health](https://hotfix.jobs/companies/prompt-health)
**Location:** Remote
**Role:** ML Engineering
**Salary:** $160k – $220k/yr
**Experience:** 4+ years
**Skills:** Python, LLMs, RAG, Docker, AWS, FastAPI, Streamlit, Pydantic, Sqlalchemy, Postgres
**Posted:** 2026-01-05

> Builds and deploys end-to-end AI/ML systems, including LLM workflows and rapid prototypes for internal tools and product features in healthcare. Requires 4+ years experience, strong full-stack skills, evaluation/monitoring expertise, and Python proficiency.

## Job Description

## Responsibilities
- Drive Prompt's mission to improve healthcare through modern technology including AI
- Lead AI projects from ideation → architecture → production → iteration until tools are widely adopted and loved
- Design, build, and deploy end-to-end AI systems across both traditional ML and LLM-based workflows
- Partner with stakeholders across the company to understand workflows, define success criteria, and deliver practical solutions
- Support internal as well as product-facing AI initiatives as needed
- Design and implement evaluation, monitoring, and observability metrics (accuracy, cost, latency, and business impact)
- Build guardrails around LLM pipelines including validation and human-in-the-loop workflows
- Develop rapid proofs-of-concept and prototypes, then harden them into reliable systems
- Help grow and lead the AI team, including training and development of junior team members

## Qualifications
- 4+ years of experience building AI/ML systems in industry or academia, with meaningful production ownership
- Strong experience building and operating AI systems end-to-end, not just models in isolation
- Strong experience with LLM-based systems (**programmatic prompt optimization**, evaluation, prompting, structured outputs, RAG, multi-step workflows)
- Solid understanding of evaluation and measurement for AI systems (offline metrics, online monitoring, regressions, cost tracking)
- Ability to work closely with non-technical stakeholders to translate workflows into effective AI solutions
- Strong software engineering fundamentals and ability to ship maintainable, production-grade systems
- Track record of benchmarking and iteratively improving accuracy, cost, and latency
- Excellent communication skills, with the ability to explain complex AI concepts to non-technical stakeholders
- **Python (>3.9)**
- **Docker** (Basics)
- **AWS** familiarity (S3, RDS, EC2) preferred
- Strong problem-solving mindset and ability to operate effectively in ambiguous, fast-paced settings
- Willingness to learn and deeply understand the healthcare sector, specifically physical therapy, occupational therapy, and speech therapy

## Nice-to-Haves
- Experience building internal AI tools or platforms used across multiple business functions
- Experience designing evaluation harnesses for LLM workflows (golden datasets, regression tests, human review loops)
- Experience setting up analytics and dashboards to track AI usage, outcomes, and ROI
- Familiarity with workflow automation and business systems (CRMs, support tools, analytics platforms)
- Experience with **FastAPI**, **Streamlit**, **Pydantic**, **SQLAlchemy**, **PostgreSQL**
- Experience with retrieval systems (vector search, hybrid search, grounding and citation strategies)
- Experience building healthcare software and/or data processing pipelines

## Similar roles

- [Senior Software Engineer](https://hotfix.jobs/jobs/423c60aa-ca4c-400d-babe-a50099433cbb) - SpotOn - Chicago, IL - $160k – $190k/yr
- [Senior Engineer, Applied AI](https://hotfix.jobs/jobs/fde322de-5f40-47c3-81b1-e7c042bd1df2) - Honor - Remote - $160k – $180k/yr
- [Senior Software Engineer, AI Runtime](https://hotfix.jobs/jobs/f56a1580-de92-4d64-bf6f-dcedbf8b8082) - Databricks - Mountain View, CA - $160k – $225k/yr
- [Senior AI Engineer](https://hotfix.jobs/jobs/2716f0ca-948f-41b7-83c2-06362589b8a7) - Octus - New York, NY - $160k – $170k/yr
- [Senior Forward-Deployed Engineer, Federal](https://hotfix.jobs/jobs/d963f808-e129-4719-ac6b-6aaa2103050f) - Deepgram - Washington, DC - $160k – $200k/yr

**Apply:** https://hotfix.jobs/jobs/13f303ca-d8b8-4357-a5a2-7de425d06903
**Canonical:** https://hotfix.jobs/jobs/13f303ca-d8b8-4357-a5a2-7de425d06903