# Software Engineer - AI

**Company:** [Just Appraised](https://hotfix.jobs/companies/just-appraised)
**Location:** Remote
**Role:** ML Engineering
**Experience:** 2+ years
**Skills:** Python, Postgres, LLMs, RAG, AWS, Docker, Git, SQL, API Design, CI/CD
**Posted:** 2026-02-07

> Build and scale AI systems including conversation engines, RAG pipelines, and LLM integrations connected to government data. Requires 2+ years Python experience, production AI systems, and cloud infrastructure.

## Job Description

## Responsibilities
- Build and evolve our Conversation Engine: powering pre-drafted email, chat, and voice responses, including conversation state, memory, and high-quality response generation.
- Own the RAG pipeline end-to-end: document ingestion, chunking strategies, embeddings, indexing, retrieval (hybrid/vector), reranking, and grounded response generation.
- Implement AI Tooling / function calling: connect LLM workflows to internal systems (e.g., account lookup, case context retrieval, knowledge base queries) with strong validation and safe execution patterns.
- Design evaluation and quality systems for AI features: offline eval harnesses, golden datasets, human feedback loops, monitoring for hallucinations/grounding, and regression prevention.
- Collaborate with cross-functional teams to define, design, and ship new features.
- Work closely with business stakeholders and customers to translate requirements into technical specifications and documentation.
- Mentor and support engineering team members, promoting team efficiency and growth.
- Troubleshoot and debug complex issues, ensuring timely resolution and platform stability.
- Optimize application performance, reliability, and scalability, and uphold high standards for clean, maintainable code.
- Identify and proactively address technical debt and performance bottlenecks to drive iterative product improvement.

## Requirements
- 2+ years of experience building production software, with strong proficiency in **Python** programming.
- 2+ years of experience working with and optimizing relational databases (e.g., **SQL**, **PostgreSQL**).
- Experience with cloud infrastructure (**AWS** or similar).
- Proven experience working with **Large Language Models (LLMs)** and building production-ready **RAG pipelines**.
- Strong proficiency in **API design**, **data modeling**, relational database design, and testing methodologies.
- Proficiency with modern DevOps practices: version control (**Git**), containerization (**Docker**), **CI/CD** (**GitHub Actions**), and automated testing frameworks.

## Nice-to-Haves
- Experience designing scalable RAG pipelines for knowledge bases.
- Building conversation engines with memory, context, and state.
- Implementing LLM tooling and function-calling for system integration.
- Designing evaluation harnesses and datasets for AI feature quality.
- Preventing hallucinations and improving grounded response generation.

## Tech Stack
- Backend: **Python**
- Data: **PostgreSQL**
- AI Systems: **LLMs**, embeddings, vector retrieval, **RAG pipelines**
- Infrastructure: **AWS**, **Docker**
- Developer Tools: **GitHub**, Linear, Claude Code, Cursor, **CI/CD**, automated testing

## Benefits
- Competitive compensation and stock equity plan
- Comprehensive benefits package that includes medical, dental, vision, and life insurance
- Company sponsored pre-tax retirement savings program (401k)
- Flexible work environment that supports working from home
- Flexible PTO
- Parental Leave
- Home office stipend

## Similar roles

- [Software Engineer, Performance](https://hotfix.jobs/jobs/ff4b3339-6a08-4324-bcb6-635f3698a11d) - Nuro - Mountain View, CA - $153k – $175k/yr
- [Machine Learning Engineer, Relevance and Personalization](https://hotfix.jobs/jobs/e55bff4d-9948-4fd5-8f5e-51f0f5c17db4) - Airbnb - Remote - $166k – $195k/yr
- [Software Engineer](https://hotfix.jobs/jobs/823e27ee-a56e-4d3e-ac4d-dacbce6de23d) - Abridge - San Francisco, CA - $157k – $184k/yr
- [ML Engineer, Generative Video](https://hotfix.jobs/jobs/70497a05-ec28-442a-b182-4bb62ef208eb) - Mirage - New York, NY - $175k – $275k/yr
- [Software Engineer](https://hotfix.jobs/jobs/6d8b2f8e-891e-4d59-b0b0-632d28fa07ac) - Traba - New York, NY - $140k – $200k/yr

**Apply:** https://hotfix.jobs/jobs/2242b353-2450-4872-9c7a-9a70636cac1d
**Canonical:** https://hotfix.jobs/jobs/2242b353-2450-4872-9c7a-9a70636cac1d