# Staff+ Software Engineer, AI

**Company:** [Aleph](https://hotfix.jobs/companies/aleph)
**Location:** Remote
**Role:** ML Engineering
**Salary:** $130k – $350k/yr
**Experience:** 7+ years
**Skills:** LLMs, LLM APIs, Agent Frameworks, Model Routing, Context Management, Evaluation Infrastructure, Prompt Engineering, Tool Design, Caching, Parallel Tool Calls, Observability, Subagents, B2B Software
**Posted:** 2026-08-26

> Own the shared AI foundation powering Aleph’s financial planning products, including model routing, context and tool systems, evaluations, and observability. The role requires Staff-level experience shipping production LLM and agentic systems, strong technical judgment, and a pragmatic builder’s mindset.

## Job Description

## Responsibilities
- Own the AI foundation used by product teams, including model selection and routing, the model proxy layer, context management, and tool design.
- Build and maintain evaluation infrastructure; collaborate with customers and finance-domain experts to define quality standards and encode them in reusable evaluations.
- Ship agentic features end to end, from initial proof of concept through optimization, including prompt and context engineering, caching, parallel tool calls, and subagent patterns.
- Build observability into agent behavior to profile performance, identify bottlenecks, and prioritize improvements using data.
- Track developments in agentic systems and incorporate proven practices into engineering processes.
- Drive adoption of systems across teams without direct management.
- Trace requests across the full stack and make sound technical decisions at every layer.

## Requirements
- Production experience shipping LLM systems, including evaluations, context management, and multi-model or multi-provider routing.
- Experience with LLM APIs, agent frameworks, and user-facing products.
- Ability to build proofs of concept, make fast decisions, and ship incremental first versions.
- Strong judgment in designing pragmatic, opinionated abstractions.
- Strong software engineering fundamentals and code-quality standards.
- High agency and a builder’s mindset, ideally from founding, engineering leadership, or startup-building experience.
- Clear, direct, and persuasive communication with technical and non-technical audiences.
- Experience building complex B2B products, ideally from scratch.
- Preference for shipping production systems rather than conducting research.

## Similar jobs

- [Staff AI Engineer](https://hotfix.jobs/jobs/ef3edbe2-3c9e-4733-8345-40c8d0307d13) - Grafana Labs - Remote - CA$164k – CA$197k/yr
- [Staff Applied Scientist, Personalization](https://hotfix.jobs/jobs/f3f16be4-af38-4045-b3a6-cb954a5272da) - OnePay - Remote - $180k – $250k/yr
- [Staff AI Enablement Engineer](https://hotfix.jobs/jobs/f66b54fc-c0f6-41bc-aa3e-dd03ad31f295) - Talkiatry - Remote - $190k – $230k/yr
- [Senior/Staff Engineer, Machine Learning - Online Mapping](https://hotfix.jobs/jobs/2dbc058c-d88d-4b51-8d5e-acacb5130b4c) - Nuro - Mountain View, CA - $194k – $291k/yr
- [Senior/Staff Software Engineer, ML Inference Platform](https://hotfix.jobs/jobs/1b014e68-d8bc-4d84-b03a-d94b7a57c90f) - Nuro - Mountain View, CA - $194k – $352k/yr

**Apply:** https://hotfix.jobs/jobs/158dc955-461d-45ca-b5e2-61aa32ce5bca
**Canonical:** https://hotfix.jobs/jobs/158dc955-461d-45ca-b5e2-61aa32ce5bca