Skip to content
RedditRedditUnited States

Senior Software Engineer, GenAI Platform

Leads development of Reddit's large-scale GenAI Platform, including LLM Gateway, RAG applications, and agentic AI workflows. Requires 5+ years in ML/AI platform engineering with expertise in cloud, Kubernetes, and MLOps practices.

191k – 267k
Remote5+ YOEML Engineering

About the role

What You’ll Do

  • Contribute to the design, implementation, and maintenance of the LLM Gateway, focusing on features like unified API endpoints for internal/externally hosted LLM, rate/token limit management, and intelligent failover mechanisms to boost uptime and reliability.
  • Design and develop ML and Generative AI systems in cloud-based production environments at scale.
  • Build and manage enterprise-grade RAG applications using embeddings, vector search, and retrieval pipelines.
  • Implement and operationalize agentic AI workflows with tool use using frameworks such as LangChain and LangGraph.
  • Drive adoption of MLOps / LLMOps practices, including CI/CD automation, versioning, testing, and lifecycle management.
  • Establish best practices for observability, monitoring, evaluation, and governance of GenAI pipelines in production.
  • Strong ownership mindset and platform thinking.
  • Ability to lead AI platform delivery from concept to production.

Who You Might Be

  • 5+ years of experience in ML Engineering, AI Platform Engineering, or Cloud AI Deployment roles.
  • Experience operating orchestration systems such as Kubernetes at scale.
  • Deep experience with cloud-based technologies for supporting an ML platform, including tools like AWS, Google Cloud Storage, infrastructure-as-code (Terraform), and more.
  • Proficiency with the common programming languages and frameworks of ML, such as Go, Python, etc.
  • Excellent communication skills with the ability to articulate technical AI concepts to non-technical stakeholders.
  • Strong focus on scalability, reliability, performance, and ease of use.
  • Strong knowledge of model serving, inference pipelines, monitoring, and observability for AI systems is a plus.
  • Strong proficiency in Python and experience with modern AI/ML frameworks (e.g. LangChain, Vertex AI Agent Builder, TensorFlow, PyTorch) is a plus.

Skills

PythonGoKubernetesAWSTerraformGCPLangChainLangGraphTensorFlowPyTorch

Similar roles

ML Engineering jobs
Reddit

Senior Software Engineer

RedditChicago, IL

Senior Software Engineer at Reddit building scalable distributed systems, integrating applied ML and Generative AI for real-time search, ad ranking, and data pipelines to drive advertiser revenue growth. Requires BS in CS/Engineering and 5+ years experience.

191k – 267k
Remote5+ YOEML Engineering
Airbnb

Senior Machine Learning Engineer, Relevance and Personalization

AirbnbUnited States

Senior ML Engineer on Airbnb's Relevance and Personalization team building end-to-end ranking algorithms, models, and infrastructure for search, recommendations, and marketplace optimization using large-scale structured and unstructured data.

191k – 225k
Remote5+ YOEML Engineering
Illumio

Sr. Machine Learning Engineer

IllumioSunnyvale, CA

Architects high-scale distributed systems and agentic AI for cybersecurity platform, processing massive data with Kafka, Spark/Flink, and Kubernetes. Requires 5-8 years backend experience in Java/Python/Go and expertise in agentic frameworks, RAG, and cloud infrastructure.

191k – 220k
On-site5+ YOEML Engineering
David AI

Senior Machine Learning Research Engineer

David AISan Francisco, CA

Build cutting-edge speech and audio ML models, production inference systems, and resilient pipelines. Own full ML lifecycle from research to deployment on terabytes of audio data.

190k – 260k
On-site5+ YOEML Engineering
Fieldguide

Senior AI Engineer

FieldguideSan Francisco, CA

Builds and ships AI agents that automate complex audit workflows using LLMs, retrieval pipelines, and orchestration logic. Owns end-to-end development, evaluation, reliability, and mentoring while partnering with product and design teams. Requires 3+ years experience with production LLM features.

190k – 255k
Hybrid3+ YOEML Engineering