# Software Engineer, Applied AI

**Company:** [Norm Ai](https://hotfix.jobs/companies/norm-ai)
**Location:** New York, NY
**Role:** ML Engineering
**Salary:** $190k – $280k/yr
**Experience:** 4+ years
**Skills:** Python, Docker, Postgres, Redis, TypeScript, React, LLMs, Ai/Ml Infrastructure, Prompt Engineering, Machine Learning, Evaluation Frameworks
**Posted:** 2026-06-29

> Build and ship reliable, scalable LLM-powered AI agents for high-stakes legal workflows at an agentic law platform. Requires 4+ years software/AI engineering experience, strong Python skills, production ML/LLM integration experience, and AI fluency.

## Job Description

## Responsibilities
- Build and integrate LLM-backed workflows, including prompt systems, retrieval, memory, evaluation, and feedback loops.
- Develop new AI workflows and systems that make cutting-edge AI available across the platform.
- Regularly contribute performant, high-quality code to the production codebase.
- Oversee data collection, experimentation, and data analysis to continuously improve the platform, working closely with domain experts.
- Build comprehensive benchmarks and evaluation suites to measure AI agent performance and guide future improvements.
- Architect the system of underlying prompts that power AI agents, engineering effective context structures and automated pipelines for prompt optimization.
- Enable continuous learning in AI agents through memory, feedback, and client-specific preferences.
- Develop legal and compliance domain expertise.

## Requirements
- 4+ years of experience as a software engineer, applied AI engineer, ML engineer, or data scientist.
- Strong programming skills in Python.
- Proficiency in Docker and data storage technologies such as Postgres and Redis.
- Experience working with production systems, including debugging, monitoring, and iterating on live software.
- Willingness to work with frontend technologies (Typescript, React, etc.) to bridge research ideas and productization.
- Experience in AI/ML infrastructure and tooling.
- Experience integrating AI or ML components into real-world systems (LLMs, classical ML, or hybrid approaches).
- Interest in becoming a legal and compliance domain expert and working closely with professionals in the field.
- Strong reading, writing, and quantitative skills, as well as a data-driven approach to problem solving.
- AI fluency: actively use AI in day-to-day work with concrete examples of tools, workflows, and outcomes.

## Nice-to-Haves
- Familiarity with and an eagerness to apply the latest AI research.
- Experience applying traditional ML systems and processes in the context of state-of-the-art LLMs.
- Experience deriving insights from PDFs and other unstructured or semi-structured data types.
- Experience with context engineering and memory in the context of AI agents.
- Experience modeling uncertainty in ML systems.

## Compensation and Benefits
- **Senior Engineer**: $190,000 - $250,000 per year + equity
- **Staff Engineer**: $240,000 - $280,000 per year + equity
- Competitive salary with equity compensation.
- Comprehensive benefits: 401(k) with employer match, top-tier health, dental, hospital, accident, and vision insurance.
- Relocation reimbursement for candidates moving to NYC.
- Flexible hybrid model (typically in-office 3–4 days per week).

## Similar roles

- [AI Engineer](https://hotfix.jobs/jobs/3e81f9d7-b85f-486a-849e-d1417b241b1e) - Zoox - Foster City, CA - $190k – $250k/yr
- [ML Engineer](https://hotfix.jobs/jobs/98ad2c38-046c-4b23-9f02-cb395af69959) - Sesame - San Francisco, CA - $190k – $320k/yr
- [Data Scientist, Underwriting](https://hotfix.jobs/jobs/4a054585-2634-407e-aa40-182679349330) - Parafin - San Francisco, CA - $190k – $300k/yr
- [Software Engineer - Behavior Capabilities](https://hotfix.jobs/jobs/07184ed0-bd8d-46fe-92cd-a18258309fb4) - Zoox - Foster City, CA - $189k – $270k/yr
- [Software Engineer - Learned Trajectory Machine Learning Engineer](https://hotfix.jobs/jobs/58417c3f-47c5-46eb-8ffb-27ad8502a9a3) - Zoox - Foster City, CA - $189k – $270k/yr

**Apply:** https://hotfix.jobs/jobs/be4d97f1-9f2f-4973-bac2-0de1198d845e
**Canonical:** https://hotfix.jobs/jobs/be4d97f1-9f2f-4973-bac2-0de1198d845e