Skip to content
BasetenBasetenSan Francisco, CA

Software Engineer - AI Developer Productivity

Build and operate Baseten’s internal AI developer platform, including agent infrastructure, evaluation systems, developer tooling, and CI/CD integrations. The role requires 4+ years of relevant experience, strong Python or Go skills, hands-on LLM and agent-framework experience, and familiarity with Kubernetes and Docker.

165k – 330k/yr
Hybrid4+ YOEFullstack Engineering

About the role

Responsibilities

  • Own the internal AI developer platform end to end, including architecture, build, rollout, operation, and measurement.
  • Evaluate and integrate third-party AI coding tools such as Claude Code, Cursor, and Codex.
  • Build the context layer that enables AI coding tools to work effectively against the monorepo.
  • Build frameworks that let engineers create their own agents without deep LLM expertise.
  • Establish evaluation practices for AI-assisted development and use them to guide investment decisions.
  • Drive adoption through developer experience, good defaults, clear documentation, and low-friction onboarding.
  • Embed with teams to identify where AI can unblock them and generalize successful approaches into platform capabilities.
  • Own permissions, secrets handling, audit trails, and cost management.

Requirements

  • 4+ years of relevant industry experience building and enabling AI-native software development lifecycles.
  • Strong proficiency in Python and/or Go and experience building tools used daily by other engineers.
  • Hands-on experience with LLMs and agent frameworks, including tool calling, MCP, context management, orchestration, and failure handling.
  • Experience shipping agentic systems used by real people.
  • Deep familiarity with AI coding tools and informed perspectives on their limitations.
  • A platform mindset focused on adoption, self-service, internal developer experience, and good defaults.
  • Experience with developer tooling, CI/CD, and Kubernetes/Docker fundamentals.
  • Comfort working in an ambiguous and rapidly changing environment.
  • Excellent written communication, particularly for documentation, templates, and examples.

Benefits and Compensation

  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employees and dependents.
  • Flexible PTO, including a company-wide Winter Break from Christmas Eve through New Year's Day.
  • Paid parental leave.
  • Fertility and family-building stipend through Carrot.
  • Company-facilitated 401(k).
  • Exposure to a variety of ML startups and opportunities for learning and networking.

Skills

PythonGoLLMsmcpAgent FrameworksCI/CDKubernetesDockerClaude CodeCursorCodextool callingcontext managementorchestrationaudit logging

Similar roles

Fullstack Engineering jobs
Office Hours

Software Engineer, Full Stack

Office HoursSan Francisco, CA +2

Build and ship end-to-end product features for a knowledge-sharing platform, spanning React/Next.js frontend and Node.js/TypeScript backend services. Collaborate with design/product teams; requires 3+ years experience across full stack.

165k – 185k/yrHybrid3+ YOEFullstack Engineering
Orb

Software Engineer, Real Time Analytics

OrbSan Francisco, CA

Build real-time analytics, alerting, entitlements, and spend control primitives for Orb's usage-based billing platform. Own product surfaces end-to-end, from customer conversations and API design to implementation, with strong emphasis on low-latency systems and customer empathy.

165k – 225k/yrHybrid3+ YOEFullstack Engineering
Jellyfish

Full Stack Engineer

JellyfishBoston, MA

Full Stack Engineer builds and ships SaaS features using TypeScript, Python, React, and Django in an agile team with daily AWS deployments. Requires 5+ years experience, startup interest, and strong collaboration skills.

165k – 235k/yrRemote5+ YOEFullstack Engineering
Baseten

Software Engineer - Enterprise Platform

BasetenSan Francisco, CA +1

Architects and leads development of enterprise platform infrastructure, including self-hosted clusters, compliance solutions, and multi-cloud orchestration for AI inference. Requires 5+ years in distributed systems or Kubernetes, with enterprise security experience.

165k – 330k/yrHybrid5+ YOEFullstack Engineering
Roboflow

Full Stack Engineer

RoboflowNew York, NY +1

Build and maintain core computer vision platform handling image processing, annotation, training, and deployment. Work across full stack with JavaScript/Node.js, Python ML pipelines, cloud infra; contribute to scaling processes in distributed team.

165k – 195k/yrRemoteFullstack Engineering