Skip to content

AI Engineer

Builds, evaluates, and deploys LLM-driven features like document analysis and chat experiences using models from OpenAI, Anthropic, and Gemini. Requires 5+ years in software engineering and AI/ML, Python proficiency, and product thinking for scalable systems.

200k – 380kNew York, NYML EngineeringOnsite5+ YOE

About the role

Responsibilities

  • Collaborate closely with team to productize new AI-powered capabilities, such as AI proposal writing & search experiences.
  • Evaluate and monitor performance of AI models (OpenAI, Anthropic, Gemini, Parallel.ai) & systems through rigorous testing and experimentation.
  • Stay up-to-date with latest AI and machine learning research, proactively suggest improvements to generative AI capabilities.
  • Implement strong testing and CI/CD practices for AI system development.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Mathematics, related field, or equivalent experience.
  • Experience working in a startup or smaller company with real engineering impact.
  • 5+ years professional experience in software engineering, AI/ML development including:
    • Proficiency with production software (Python) and systems design.
    • Machine learning algorithms and model development techniques.
    • ML lifecycle tools like MLflow, dvc, Weights & Biases.
    • Cloud deployment of ML systems.
    • Professional experience with LLMs and large-scale models.
    • Very strong software engineering skills building scalable, distributed product machine learning systems.
    • Product thinking: ability to take product requirements and strategize how to apply LLMs.
    • Ability to communicate complex ideas effectively.

Preferred Skills

  • Experience building scalable applications with LLMs using frameworks such as LangGraph, LiteLLM, Agent Client Protocol, Koog.
  • Depth of knowledge with RAG implementation and improvements.
  • Proficiency with Kotlin.

Benefits

  • Competitive salary + early-stage equity.
  • Comprehensive medical, dental, and vision insurance.
  • Company provided lunch in office everyday.
  • 75% coverage of Chelsea Piers Fitness membership.
  • Unlimited PTO.
  • Regular offsites (NYC + global locations).">

Skills

PythonLLMsMachine LearningMLflowWeights & BiasesDvcLangGraphLitellmRAGKotlin

Similar roles

ML Engineering jobs

AI System Research and Development Engineer - Optimization

Develop and optimize GPU kernels and deep learning systems for LLM training and inference at Snowflake AI Research. Requires 5+ years in GPU/HPC optimization and strong proficiency in PyTorch, TensorFlow, JAX, and CUDA.

200k – 265kBellevue, WAML EngineeringOn-site5+ YOEJAXCUDA

Post-Training Research Engineer

Build in-house tooling for post-training custom ML models using advanced techniques like RL and finetuning. Requires deep expertise in transformer training, PyTorch distributed systems, parallelism strategies, GPU performance optimization, and HPC platforms.

200k – 275kSan Francisco, CAML EngineeringHybridJAXRay

Machine Learning Engineer, Enterprise Brain

Develop ML systems for the Enterprise Brain, focusing on proactive AI for task prediction, automation, and agentic workflows using LLMs and advanced techniques. Requires 3+ years ML experience, Python proficiency, and expertise in evaluation and production systems.

200k – 300kPalo Alto, CA +1ML EngineeringHybrid3+ YOELLMsPython

Machine Learning Engineer, Images

Designs, fine-tunes, and deploys image generation models for photorealistic AI bots, optimizing for consistency, latency, and quality. Requires 5+ years software engineering, 2+ years production ML, and expertise in diffusion models like Stable Diffusion and PyTorch.

200k – 265kSan Francisco, CAML EngineeringRemote5+ YOEGCPAWS

Research Engineer, Core ML

Research Engineer building production ML systems at the intersection of efficient inference, RL/post-training, and serving engines. Translates algorithms into scalable infrastructure improving latency, throughput, and model quality. Requires 3+ years ML systems experience and advanced degree.

200k – 280kSan Francisco, CAML EngineeringOn-site3+ YOEDpovLLM