# Software Engineer, AI Product Engineer

**Company:** [Retool](https://hotfix.jobs/companies/retool)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $164k – $306k/yr
**Experience:** 3+ years
**Skills:** TypeScript, Node.js, React, LLMs, RAG, Vector Databases, Prompt Engineering, Postgres, MLOps, JavaScript
**Posted:** 2025-02-07

> Builds AI-powered features for developer tools, including generative UIs from natural language, LLM performance improvements, and RAG patterns. Requires 3+ years experience with LLMs, modern AI techniques, and full-stack engineering in TypeScript/Node.js/React.

## Job Description

## What You'll Do

- Build generative UIs that let users create real apps from natural language
- Improve the performance, observability, and safety of our internal model architecture
- Extend our AI evaluation systems to support smarter ranking, feedback loops, and product metrics
- Develop patterns for retrieval-augmented generation (RAG), few-shot prompting, and agentic architecture
- Contribute to building internal tools that help us accelerate iteration on AI features and workflows

You'll work in a **TypeScript + Node.js + React** stack.

## The Skillset You'll Bring

- **3+ years** of professional software engineering experience
- A track record of building and shipping real product—not just models or papers
- Experience working with **LLMs** and modern techniques (**RAG**, **CoT**, few-shot, embeddings, etc.)
- An eye for product: you care how features work and how they feel
- Familiarity with **vector databases**, **prompt orchestration tools**, and evaluation techniques
- A pragmatic mindset about what’s scalable and maintainable in production

## Nice to Have

- Experience in **JavaScript / TypeScript**
- Experience with **PostgreSQL**
- Exposure to **MLOps** techniques (e.g., fine-tuning pipelines, model hosting)
- Experience mentoring other engineers or working closely with design

## Similar roles

- [Software Engineer - Voice AI (Inference Runtime)](https://hotfix.jobs/jobs/53a7ab9f-cf11-4bde-9646-c3bbdea3c0ad) - Baseten - San Francisco, CA - $165k – $330k/yr
- [Forward Deployed Engineer, Deepgram for Restaurants](https://hotfix.jobs/jobs/3e0f6a46-146c-4ecd-9d4a-f1a61427be5e) - Deepgram - Remote - $165k – $220k/yr
- [Software Engineer, AI/ML](https://hotfix.jobs/jobs/79829b86-da09-45a9-b27a-329f2888328a) - Tabs - New York, NY - $165k – $225k/yr
- [Fullstack Software Engineer, Applied AI](https://hotfix.jobs/jobs/557ac0c0-36f8-49b8-acb1-8973974334dc) - LangChain - New York, NY - $165k – $190k/yr
- [Software Engineer - Training Infrastructure](https://hotfix.jobs/jobs/8ab5aff7-f0c3-4cc7-8796-5c868b5098cd) - Baseten - San Francisco, CA - $165k – $330k/yr

**Apply:** https://hotfix.jobs/jobs/eed899e1-5bb5-4f1a-8ce5-3e622f1f3044
**Canonical:** https://hotfix.jobs/jobs/eed899e1-5bb5-4f1a-8ce5-3e622f1f3044