AI Engineer - Workflows
Build modular AI operations and evaluation systems that power complex real estate workflows. The role focuses on improving output quality, defining correctness with domain experts, and reducing human review while maintaining high standards.
About the job
Responsibilities
- Build and own the modular operations that compose workflows.
- Identify underperforming outputs and improve the underlying capabilities.
- Build evaluation harnesses to determine whether changes improve results.
- Work with domain experts to define correctness standards.
- Reduce the human review required by workflows without lowering quality.
- Maintain a composable capability library as it grows.
- Perform failure analysis and own quality end-to-end, from prompts through delivered artifacts.
Requirements
- Experience building evaluations rather than only running them.
- Comfort working to standards defined by domain experts.
- Strong ownership, execution speed, analytical ability, and attention to quality.
Compensation
- $120,000–$240,000 annual salary.
- Meaningful equity.
Skills
Artificial Intelligence, Agentic AI, Workflow Automation, Prompt Engineering, Evaluation Harnesses, Failure Analysis, Quality Assurance
Similar jobs
ML Engineering jobs
Build
New York, NYBuild and operate Dougie, an agentic AI system that executes workflows, evaluates its own performance, retains institutional context, and improves in production. The role requires experience deploying unattended agentic systems and engineering reliable memory, retrieval, orchestration, and feedback loops.
Coalition Security
United StatesBuild and operate LLM-powered agents that automate business workflows, integrating systems of record through MCP and validating behavior with structured evaluations. Requires 5+ years of software development experience, strong Python and SQL, and hands-on experience shipping agents to production.
Build
New York, NYBuild and ship production agentic AI workflows for complex real estate and built-world processes. The role combines product engineering, applied AI, customer collaboration, workflow orchestration, evaluation, and reliable user-facing experiences.
Mintlify
San Francisco, CA
Build and own customer-facing AI products from experimentation through production, including reliable agents, evaluation systems, APIs, interfaces, and infrastructure. Requires at least four years of software development experience and deep production experience with language-model systems.
PathAI
Boston, MADevelop and deploy machine learning models for biomedical research and AI products, collaborating with scientific, engineering, and product teams. Requires an advanced quantitative degree, substantial ML experience, Python proficiency, and experience bringing models into production or research applications.