Skip to content
StarbridgeStarbridgeNew York, NY

AI Engineer

Builds, evaluates, and deploys LLM-driven features like document analysis and chat experiences using models from OpenAI, Anthropic, and Gemini. Requires 5+ years in software engineering and AI/ML, Python proficiency, and product thinking for scalable systems.

200k – 380k/yr
On-site5+ YOEML Engineering

About the role

Responsibilities

  • Collaborate closely with team to productize new AI-powered capabilities, such as AI proposal writing & search experiences.
  • Evaluate and monitor performance of AI models (OpenAI, Anthropic, Gemini, Parallel.ai) & systems through rigorous testing and experimentation.
  • Stay up-to-date with latest AI and machine learning research, proactively suggest improvements to generative AI capabilities.
  • Implement strong testing and CI/CD practices for AI system development.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Mathematics, related field, or equivalent experience.
  • Experience working in a startup or smaller company with real engineering impact.
  • 5+ years professional experience in software engineering, AI/ML development including:
    • Proficiency with production software (Python) and systems design.
    • Machine learning algorithms and model development techniques.
    • ML lifecycle tools like MLflow, dvc, Weights & Biases.
    • Cloud deployment of ML systems.
    • Professional experience with LLMs and large-scale models.
    • Very strong software engineering skills building scalable, distributed product machine learning systems.
    • Product thinking: ability to take product requirements and strategize how to apply LLMs.
    • Ability to communicate complex ideas effectively.

Preferred Skills

  • Experience building scalable applications with LLMs using frameworks such as LangGraph, LiteLLM, Agent Client Protocol, Koog.
  • Depth of knowledge with RAG implementation and improvements.
  • Proficiency with Kotlin.

Benefits

  • Competitive salary + early-stage equity.
  • Comprehensive medical, dental, and vision insurance.
  • Company provided lunch in office everyday.
  • 75% coverage of Chelsea Piers Fitness membership.
  • Unlimited PTO.
  • Regular offsites (NYC + global locations).">

Skills

PythonLLMsMachine LearningMLflowWeights & BiasesDvcLangGraphLitellmRAGKotlin

Similar roles

ML Engineering jobs
Console

Research Engineer

ConsoleSan Francisco, CA

Research Engineer building self-improving AI agent systems at Console. Develop eval/optimization loops, fine-tune specialist models, and improve agent reasoning over enterprise context using production data to drive measurable gains in quality, latency, and reliability.

200k – 350k/yr
On-siteML Engineering
Kepler

Machine Learning Engineer

KeplerNew York, NY

Build and own ML models, fine-tuning, evaluation harnesses, and routing for Kepler's AI agent harness in finance. Requires 5+ years production software experience and shipped ML systems focused on correctness, evals, and real-world reliability.

200k – 280k/yr
On-site5+ YOEML Engineering
AfterQuery

Machine Learning Engineer

AfterQuerySan Francisco, CA

Build production ML systems for measuring, predicting, and scaling data quality for frontier AI models. Requires 3-6 years experience in applied ML or related production systems (ranking, recommendations, data quality, fraud) plus strong software engineering skills.

200k – 300k/yr
On-site3+ YOEML Engineering
Tennr

Machine-Learning Operations Engineer

TennrNew York, NY

Founding ML Operations Engineer building scalable training, inference, and evaluation pipelines for proprietary VLMs and LLMs in healthcare. Requires 5+ years production ML infrastructure experience, strong Python/TypeScript skills, and ownership in a fast-paced startup.

200k – 230k/yr
On-site5+ YOEML Engineering
Glean

Machine Learning Engineer, Enterprise Brain

GleanMountain View, CA

Machine Learning Engineer building the Enterprise Brain - a proactive AI system for task detection, automation, reasoning, planning and personalization using LLMs, RL, fine-tuning, and advanced ranking on top of enterprise and personal knowledge graphs. Requires 3+ years ML experience, strong production ML skills, and expertise in evaluation/benchmarking.

200k – 300k/yr
Hybrid3+ YOEML Engineering