# Senior Software Engineer, Training & Experimentation

**Company:** [Lightning AI](https://hotfix.jobs/companies/lightning-ai)
**Location:** New York, NY, San Francisco, CA
**Role:** Backend Engineering
**Salary:** $180k – $250k/yr
**Experience:** 5+ years
**Skills:** Go, Python, Rust, Distributed Systems, Asynchronous Processing, APIs, AWS, GCP, Azure, Docker, Kubernetes, Observability, Continuous Delivery, Automated Testing, Cloud-Native Architecture
**Posted:** 2026-08-07

> Build scalable backend services and infrastructure for AI agent orchestration, including APIs, workflow execution, memory, and state management. The role requires extensive backend and distributed-systems experience, cloud-native architecture expertise, and the ability to lead initiatives through production.

## Job Description

## Responsibilities
- Design and build backend services that power AI agent orchestration and execution.
- Develop scalable APIs and platform capabilities for tool use, workflow orchestration, memory, and state management.
- Build reliable infrastructure for long-running, distributed AI workflows.
- Partner with product, research, and platform engineering teams to bring new agent capabilities into production.
- Improve platform reliability, observability, and performance as customer workloads scale.
- Evaluate and strengthen technical architecture, engineering processes, and developer tooling.
- Maintain high standards of software quality through testing, automation, continuous delivery, and proactive technical-debt management.
- Mentor engineers on system design, distributed systems, and backend engineering best practices.

## Requirements
- Extensive experience building scalable backend systems using Go, Python, Rust, or similar languages.
- Strong understanding of distributed systems, asynchronous processing, APIs, and cloud-native application architecture.
- Experience designing and operating production services at scale.
- Hands-on experience building backend platforms, developer tools, or infrastructure products.
- Familiarity with cloud platforms such as AWS, GCP, or Azure and container technologies including Docker and Kubernetes.
- Proven ability to own large technical initiatives from architecture through production.
- Commitment to software quality, automated testing, observability, and continuous delivery.
- Strong communication skills and effective collaboration across engineering, product, research, and design teams.
- Ability to thrive in fast-moving, ambiguous environments while balancing technical excellence with product impact.

## Compensation and Benefits
- Annual base salary: **$180,000–$250,000 USD**.
- Discretionary bonus and meaningful equity component.
- Medical, dental, and vision coverage for employees and eligible dependents.
- RSUs.
- 401(k) matching in the U.S. and pension contributions in the U.K.
- Unlimited PTO, company holidays, and floating holidays.
- Two-week company-wide winter break.
- Paid parental and family leave.
- Annual learning and development allowance.
- Wellness and work-from-home stipends.
- Four weeks of paid sabbatical leave after four years of service.
- Flexible schedules and a hybrid work model for office-based teams.
- Complimentary meals at office hubs.
- Benefits may vary by location, team, and role.

## Similar jobs

- [Senior Software Engineer, Platform](https://hotfix.jobs/jobs/b6aab700-8a56-4a32-bf1b-a6633d5a779b) - Maybern - New York, NY - $180k – $230k/yr
- [Media Software Engineer, Speech](https://hotfix.jobs/jobs/76fb31a9-3820-4744-870f-0997c3c9b33d) - Cantina - Sunnyvale, CA - $180k – $270k/yr
- [Senior Software Engineer, Backend](https://hotfix.jobs/jobs/6163f6fb-5395-404c-b1d2-427fe0637b22) - Duolingo - Pittsburgh, PA - $183k – $247k/yr
- [Senior Software Engineer, Backend](https://hotfix.jobs/jobs/fa632a1a-42dc-411b-82a2-70f55bb28408) - Duolingo - New York, NY - $183k – $247k/yr
- [Senior Software Engineer, Cloud Growth](https://hotfix.jobs/jobs/ed76541f-510f-4808-b52f-750ae033898e) - Temporal - Remote - $176k – $231k/yr

**Apply:** https://hotfix.jobs/jobs/d815cdca-e810-4c01-8fe5-e8467a12c7cb
**Canonical:** https://hotfix.jobs/jobs/d815cdca-e810-4c01-8fe5-e8467a12c7cb