# Engineering Manager, AI

**Company:** [Permitflow](https://hotfix.jobs/companies/permitflow)
**Location:** New York, NY
**Role:** Engineering Management
**Salary:** $180k – $250k/yr
**Experience:** 5+ years
**Skills:** Ai Systems, Agentic Systems, System Design, Model Serving, Llm Evaluation, Llm-As-Judge, Human Annotation, Online Monitoring, Observability, Workflow Orchestration, Architecture, Machine Learning
**Posted:** 2026-09-09

> Leads the engineering team responsible for production agentic infrastructure and evaluation systems, combining people management with hands-on technical direction. The role requires 5+ years of software engineering experience, engineering leadership, and experience shipping AI systems.

## Job Description

## Responsibilities
- Lead and grow an engineering team building and hardening agentic infrastructure.
- Establish engineering culture through clear expectations, 1:1s, feedback, and career development.
- Own the architecture of workflow agents, including orchestration, model serving, latency, cost per task, and failure handling.
- Define reliability standards for autonomous permit submission and build release-gating systems against those standards.
- Build evaluation infrastructure, including golden datasets, LLM-as-judge pipelines, human annotation tools, and online monitoring for drift and regressions.
- Develop internal tooling for testing, error analysis, and iterative improvement of agentic systems.
- Improve reliability, observability, and engineering efficiency across the AI stack.
- Hire and develop engineers with ML/AI systems expertise and future engineering leaders.

## Requirements
- 5+ years of software engineering experience, including 1+ year in engineering leadership.
- Direct experience building or shipping a production AI or agentic system, including its supporting infrastructure.
- Hands-on familiarity with evaluation infrastructure such as golden datasets, LLM-as-judge systems, human annotation, or online monitoring.
- Strong system design and architecture fundamentals, including judgment about when to use agents versus simpler systems.
- Ability to lead through ambiguity and turn unclear problems into structured execution.
- Strong technical fluency in code reviews, architecture reviews, and model/system tradeoffs.
- Strong communication skills with technical and non-technical stakeholders.
- High standards for engineering quality, reliability, and performance.

## Nice-to-haves
- Experience with workflow-heavy, enterprise SaaS, or infrastructure products.
- Exposure to complex regulated environments such as construction, logistics, or government systems.

## Compensation and Benefits
- $180,000–$250,000 annual salary.
- Meaningful equity.
- Company-paid medical, dental, and vision coverage, plus healthcare FSA.
- 401(k) savings plan.
- Unlimited paid time off and paid family leave.
- Home office and equipment stipend.
- Daily in-office lunch and dinner.
- Commuter benefits for transit and parking.

## Similar jobs

- [Engineering Manager, New Products](https://hotfix.jobs/jobs/0b2ce56c-5834-4cb4-8ac8-47db7032f2c4) - Permitflow - New York, NY - $180k – $250k/yr
- [Engineering Manager](https://hotfix.jobs/jobs/0691b0ed-e442-42be-a97d-1bfde5b9b5db) - Permitflow - New York, NY - $180k – $250k/yr
- [Engineering Manager, Product](https://hotfix.jobs/jobs/7635e6e2-8f53-4b99-adb9-3c2b42a14039) - Duolingo - New York, NY - $183k – $247k/yr
- [Platform Engineering Manager - DataLake](https://hotfix.jobs/jobs/ddbf36a5-71b2-475b-b10c-ab430e61e632) - NexHealth - Seattle, WA - $176k – $220k/yr
- [Software Engineering Manager - Simulation Products](https://hotfix.jobs/jobs/eeb9d319-3757-4671-b400-b108475e3063) - Applied Intuition - Ann Arbor, MI - $185k – $230k/yr

**Apply:** https://hotfix.jobs/jobs/bb0ab13a-d8be-4959-ba62-9986ba856fe3
**Canonical:** https://hotfix.jobs/jobs/bb0ab13a-d8be-4959-ba62-9986ba856fe3