Skip to content
Scale AIScale AINew York, NY

Software Engineer, Enterprise AI

Build and scale enterprise Generative AI platform, owning large product areas across backend, frontend, LLMs, and ML models. Requires 4+ years experience, proficiency in Python/JavaScript/SQL, Kubernetes, and cloud providers.

216k – 270k
On-site4+ YOEML Engineering

About the role

Scale GP is an enterprise-grade Generative AI platform providing APIs for knowledge retrieval, inference, evaluation, and more. We're seeking a strong engineer to build and scale our product, owning large areas across backend, frontend, LLMs, and ML models while solving scalability and reliability challenges.

You will:

  • Own large new areas within our product
  • Work across backend, frontend, and interacting with LLMs and ML models
  • Deliver experiments at a high velocity and level of quality to engage our customers
  • Work across the entire product lifecycle from conceptualization through production
  • Be able, and willing, to multi-task and learn new technologies quickly

Ideally you'd have:

  • 4+ years of full-time engineering experience, post-graduation
  • Experience scaling products at hyper growth startups
  • Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies
  • Proficient in Python or Javascript/Typescript, and SQL
  • Experience with Kubernetes
  • Experience with major cloud providers (AWS, Azure, GCP)

Skills

PythonJavaScriptTypeScriptSQLKubernetesAWSAzureGCPLLMsVector Databases

Similar roles

ML Engineering jobs
Liftoff

Machine Learning Engineer

LiftoffCalifornia

Machine Learning Engineer building statistical models, optimization systems, and experiments for mobile ad tech economics on the Revenue Engine team. Requires PhD in CS/ML/Economics and industry experience applying ML or economics at scale.

215k – 275k
RemoteML Engineering
Hex

AI Research Engineer

HexSan Francisco, CA +1

Builds and deploys production AI features like Notebook Agent for data science workflows, partnering with product teams on experiments, model fine-tuning, and infra. Requires senior AI/ML engineering experience with MLOps, Python/TS proficiency.

214k – 285k
Hybrid5+ YOEML Engineering
Scale AI

ML Systems Engineer, Robotics

Scale AISan Francisco, CA

Designs and builds scalable platforms for serving foundation models in robotics and autonomous vehicles. Requires 4+ years in ML infrastructure, backend systems, GPU optimization, and cloud technologies.

218k – 273k
On-site4+ YOEML Engineering
Scale AI

ML Research Engineer, ML Systems

Scale AISan Francisco, CA +2

Builds and optimizes distributed frameworks for LLM training and inference on Scale's RLXF platform. Collaborates with ML teams to accelerate research, requiring expertise in PyTorch, CUDA, transformers, and large-scale distributed systems.

218k – 273k
On-siteML Engineering
Scale AI

Machine Learning Research Engineer, Agent Data Foundation - Enterprise GenAI

Scale AISan Francisco, CA +2

Develops synthetic data pipelines, production trace agents, and automated agent-building frameworks for enterprise GenAI. Requires 3+ years LLM production experience, top conference publications, and advanced CS degree.

218k – 273k
Hybrid3+ YOEML Engineering