Skip to content

Software Engineer - AI Agents & Platform

Builds autonomous AI agents and platform infrastructure for customer support, enhancing LLM performance with RAG techniques, scaling systems with Golang, and integrating STT/TTS. Requires 5+ years software engineering experience with LLMs.

135k – 280kSan Francisco, CAML EngineeringOnsite5+ YOE

About the role

Responsibilities

  • Build foundational new features: Develop product features from the ground up, such as implementing a way to analyze gaps in a company's knowledge base with LLMs and building sophisticated information collection techniques with cutting edge STT and TTS.
  • Help design and build a workflow builder that distills the complexity of workflows into a simple, intuitive interface.
  • Improve LLM model results: Enhance our retrieval augmented generation engine using techniques like vector search, document re-ranking, and hypothetical document embeddings.
  • Leverage implicit knowledge bases like past tickets and macros to improve model performance.
  • Develop LLM Infrastructure: Architect the abstractions that enable the integration of various types of LLMs tailored for different applications.
  • Design and implement evaluation and logging systems to monitor performance and build interfaces that expand our platform's capabilities.
  • Engage with customers: Collaborate with our customers (both support agents and managers) to understand their needs.
  • Wear many hats: Be versatile in roles — coding, user research, planning, brainstorming, interviewing, and cross-team collaboration.
  • Shape the team culture: Encourage a startup mentality.

Requirements

  • 5+ years of experience in software engineering as an individual contributor.
  • Have worked with LLMs and are excited to dive into them every day.

Nice-to-Haves

  • Experience contributing in startups or smaller companies.
  • Experience scaling LLMs with Golang.
  • Experience enhancing RAG results with Reciprocal Rank Fusion and Hybrid Search.
  • Experience pioneering new LLM evaluation techniques.

Skills

LLMsGoRAGVector SearchHybrid SearchReciprocal Rank FusionSttTtsWorkflow Builder

Similar roles

ML Engineering jobs

Machine Learning Platform Engineer

Build and operate the ML platform to productionize models, enable real-time inference, and manage the full ML lifecycle with MLOps best practices. Requires 3+ years platform engineering and 1+ years owning ML systems end-to-end.

135k – 160kUnited StatesML EngineeringRemote3+ YOEGoKafka

Software Engineer - Forecasting & Scheduling

Builds forecasting interfaces, data pipelines, and scheduling systems for thousands of support agents using ML models. Requires Python ML libraries experience and background in ML/algorithmic teams with focus on performance optimization.

135k – 280kUnited StatesML EngineeringRemoteScipyMLOps

Software Engineer - Forecasting & Scheduling

Develops forecasting interfaces, data pipelines, and scheduling systems to predict support contact volume and optimize agent schedules for thousands, incorporating ML models and constraints like labor laws. Requires Python/ML experience and performance focus.

135k – 280kSan Francisco, CAML EngineeringHybridScipyMLOps

Software Engineering Lead, Machine Learning

Leads development and deployment of ML models for NLP, retrieval, ranking, reasoning, dialog, and code-generation systems. Requires Master's/PhD, production ML experience, deep NLP expertise, Python proficiency, and MLOps knowledge in a fast-paced startup.

135k – 300kCaliforniaML EngineeringHybridNLPSQL

ML Engineer

Founding ML Engineer building production ML systems for governance, security, and agentic platform capabilities at Docker. Requires 5+ years applied ML experience shipping systems and 4+ years backend/infra engineering.

139k – 226kPalo Alto, CA +1ML EngineeringRemote5+ YOELLMsRetrieval