# Model Behavior Engineer

**Company:** [Notion](https://hotfix.jobs/companies/notion)
**Location:** New York, NY
**Role:** ML Engineering
**Salary:** $98k – $140k/yr
**Skills:** LLMs, Prompt Engineering, SQL, Ai Evals, Context Engineering, Braintrust, Ai Observability, Model Benchmarking, Data Analysis, Production Debugging
**Posted:** 2026-02-20

> Owns quality for Notion AI products through context engineering, evals, data analysis, debugging, and model evaluation with top AI labs. Requires LLM experience, analytical skills, and driver mentality; no traditional coding.

## Job Description

## What You'll Achieve
- **Context engineering** — Design, test, iterate on system prompts, tool prompts, context strategies.
- **Understand & debug** — Analyze production data, transcripts, logs, user feedback; reproduce issues, find root causes.
- **Build evals & Measurement** — Design eval strategies, build datasets, track quality, own improvement loops.
- **Evaluate and launch new models** — Benchmark models from OpenAI, Anthropic, Google on quality, latency, cost, edge cases.
- **Drive quality priorities** — Surface issues for eng/product teams, own quality narrative.
- **Build tooling & systems** — Manage AI observability (e.g., Braintrust), build playbooks/tools.

## Skills You’ll Need
- Driver mentality, bias to action.
- Curiosity about LLM capabilities.
- Analytical instinct, find signal in noise.
- Comfortable with data (SQL, coding agents).
- Clear communication.
- Experience with LLMs, prompting, or AI products.

## Nice to Haves
- Backgrounds in engineering, product, data science, research, consulting.
- Built personal projects/side projects/startups.

## Compensation
For New York City: $98,000 - $140,000 base salary per year, plus equity and benefits.

## Similar roles

- [Scientist](https://hotfix.jobs/jobs/fd1ba51c-2efc-465f-9891-a43db9ef7bcb) - Astera - Emeryville, CA - $100k – $180k/yr
- [General DiffUSE Job Application](https://hotfix.jobs/jobs/6676763d-f0db-437a-b47b-09135360f2b3) - Astera - Emeryville, CA - $100k – $300k/yr
- [AI Engineer](https://hotfix.jobs/jobs/78689d2f-baeb-4f39-9fb1-c9122eef3363) - GitLab - Remote - $108k – $130k/yr
- [Software Engineer, Generative AI](https://hotfix.jobs/jobs/5ccef877-0805-4fed-a8ae-ee43ec3dd0c5) - Writer - San Francisco, CA - $112k – $304k/yr
- [AI/ML Scientist/Developer](https://hotfix.jobs/jobs/84e165ef-2ec6-4560-852d-37e2c1b7973f) - Axle - Frederick, MD - $115k – $130k/yr

**Apply:** https://hotfix.jobs/jobs/26d5a619-a0c7-4356-b422-eb5c88496464
**Canonical:** https://hotfix.jobs/jobs/26d5a619-a0c7-4356-b422-eb5c88496464