Build and scale backend infrastructure powering agentic AI products including orchestration engines, RAG systems, evals infrastructure, and production AI workflows. Requires 4+ years distributed systems experience and deep Python plus Go/Java proficiency.
160k – 225k
On-site4+ YOEML Engineering
About the role
What you will do in this role
Build Agentic Runtimes: Help build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management.
Scale Context Engineering Infra: Develop and design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable search indexing, query processing, and semantic caching.
Develop the "Evals Engine": Build the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and experiments.
Productionize AI Workflows: Collaborate with the modeling team to take raw LLM capabilities and turn them into hardened, multi-tenant microservices with strict guardrails and observability.
Optimize Performance: Implement system optimizations for model routing, prompt caching, and token optimization to ensure maximum efficiency.
Requirements
Education: Bachelor's degree in Computer Science or a related technical field; Masters or PhD preferred.
Experience: 4+ years of industry experience designing, building, and supporting distributed systems, high-throughput APIs, machine learning platforms, or data-intensive systems.
Technical Stack: Deep proficiency in Python (for AI orchestration) and strong experience with Go or Java (for systems). Familiarity with C++ is a plus.
Systems Thinking: Strong understanding of database internals, distributed state management, and cloud-native architecture (e.g., Kubernetes, FoundationDB). Experience setting up and maintaining CI/CD pipelines is a plus.
Domain Expertise: Familiarity with the "plumbing" of AI, such as vector indices, agent platforms, building scalable data pipelines, and working with frameworks like PyTorch, TensorFlow, or XGBoost.
Mindset: A growth mindset and excitement about breaking the status quo by seeking innovative solutions.
Bonus
Query optimization and SQL engine internals.
Designing multi-tenant systems that handle sensitive enterprise data at scale.
Developing search infrastructure for large-scale applications.
Research Scientist II building and improving fraud risk models and scam detection systems using audio, behavioral, and metadata signals. Requires an advanced degree and 3+ years of applied ML experience with Python and modern ML frameworks.
160k – 185k
Remote3+ YOEML Engineering
AI Engineer - Database Engineering
SnowflakeMenlo Park, CA
As an AI Engineer, you will own the full AI engineering lifecycle, from design to optimization, for Snowflake Database Engineering products. You will build agentic workflows, coding harnesses, and evaluation pipelines, working with a high-powered engineering team.
160k – 230k
On-site5+ YOEML Engineering
ML Infrastructure Engineer
Mach9San Francisco, CA
Builds and maintains ML infrastructure for training pipelines handling massive 3D data and real-time inference serving integrated with CAD software. Requires 3+ years experience with Python, PyTorch, ML orchestration tools, data versioning, and inference optimization.
160k – 200k
On-site3+ YOEML Engineering
ML Ops Infrastructure Engineer
DeepgramCalifornia
Build and maintain ML infrastructure pipelines to deploy research models to production at scale, including CI/CD, A/B testing, monitoring, and optimization for low-latency voice AI serving. Requires 4+ years MLOps experience with Python, Docker, Kubernetes.
160k – 220k
Remote4+ YOEML Engineering
AI Engineer - Cortex Code Quality
SnowflakeMenlo Park, CA
Builds and owns end-to-end AI features for Cortex Code, including agentic workflows, context engineering, evaluations, and optimization. Requires 5+ years shipping production AI, proficiency in Python/TypeScript/Go, and bachelor's in CS or related.