Skip to content
AssembledAssembledSan Francisco, CA

Software Engineer - AI Agents & Platform

Builds autonomous AI agents and platform infrastructure for customer support, enhancing LLM performance with RAG techniques, scaling systems with Golang, and integrating STT/TTS. Requires 5+ years software engineering experience with LLMs.

135k – 280k/yr
On-site5+ YOEML Engineering

About the role

Responsibilities

  • Build foundational new features: Develop product features from the ground up, such as implementing a way to analyze gaps in a company's knowledge base with LLMs and building sophisticated information collection techniques with cutting edge STT and TTS.
  • Help design and build a workflow builder that distills the complexity of workflows into a simple, intuitive interface.
  • Improve LLM model results: Enhance our retrieval augmented generation engine using techniques like vector search, document re-ranking, and hypothetical document embeddings.
  • Leverage implicit knowledge bases like past tickets and macros to improve model performance.
  • Develop LLM Infrastructure: Architect the abstractions that enable the integration of various types of LLMs tailored for different applications.
  • Design and implement evaluation and logging systems to monitor performance and build interfaces that expand our platform's capabilities.
  • Engage with customers: Collaborate with our customers (both support agents and managers) to understand their needs.
  • Wear many hats: Be versatile in roles — coding, user research, planning, brainstorming, interviewing, and cross-team collaboration.
  • Shape the team culture: Encourage a startup mentality.

Requirements

  • 5+ years of experience in software engineering as an individual contributor.
  • Have worked with LLMs and are excited to dive into them every day.

Nice-to-Haves

  • Experience contributing in startups or smaller companies.
  • Experience scaling LLMs with Golang.
  • Experience enhancing RAG results with Reciprocal Rank Fusion and Hybrid Search.
  • Experience pioneering new LLM evaluation techniques.

Skills

LLMsGoRAGVector SearchHybrid SearchReciprocal Rank FusionSttTtsWorkflow Builder

Similar roles

ML Engineering jobs
Beacon AI

Software Engineer, Cloud Infrastructure

Beacon AISan Carlos, CA

Build and operate scalable AWS cloud infrastructure, LLM platforms, RAG systems, and data pipelines for an AI aviation platform. Requires strong AWS and LLM production experience; hybrid in San Carlos, CA.

135k – 260k/yr
Hybrid5+ YOEML Engineering
Assembled

Software Engineer - Forecasting & Scheduling

AssembledUnited States

Builds forecasting interfaces, data pipelines, and scheduling systems for thousands of support agents using ML models. Requires Python ML libraries experience and background in ML/algorithmic teams with focus on performance optimization.

135k – 280k/yr
RemoteML Engineering
Assembled

Software Engineer - Forecasting & Scheduling

AssembledSan Francisco, CA

Develops forecasting interfaces, data pipelines, and scheduling systems to predict support contact volume and optimize agent schedules for thousands, incorporating ML models and constraints like labor laws. Requires Python/ML experience and performance focus.

135k – 280k/yr
HybridML Engineering
Docker

ML Engineer

DockerPalo Alto, CA +1

Founding ML Engineer building production ML systems for governance, security, and agentic platform capabilities at Docker. Requires 5+ years applied ML experience shipping systems and 4+ years backend/infra engineering.

139k – 226k/yr
Remote5+ YOEML Engineering
Mercor

Machine Learning Engineer, Marketplace

MercorSan Francisco, CA

Build and optimize ML models for candidate-job matching, ranking, recommendations, and marketplace allocation at Mercor. Requires production ML experience with ranking/recommendation systems and strong applied ML skills across the full stack.

130k – 500k/yr
On-site5+ YOEML Engineering