# Software Engineer, Backend

**Company:** [Braintrust](https://hotfix.jobs/companies/braintrust)
**Location:** New York, NY, Seattle, WA
**Role:** Backend Engineering
**Experience:** 5+ years
**Skills:** Node.js, Go, Python, Rust, Postgres, Redis, Terraform, Docker, AWS, Grafana, Prometheus, Datadog
**Posted:** 2025-05-27

> Build scalable backend infrastructure for AI observability platform, including real-time data pipelines, LLM integrations with OpenAI/Anthropic/Gemini, and open-source tracing libraries. Requires 5+ years backend experience with Node.js/Go/Python, Postgres/Redis, AWS, and observability tools.

## Job Description

## What you'll do

- Design and ship features that give users deep insight into their LLM usage and performance.
- Integrate, proxy, cache, and collect data from OpenAI, Anthropic, Gemini, and other major model providers that our customers rely on.
- Develop and evolve robust, efficient open source libraries for tracing and evaluating LLM calls inside customer applications.
- Build highly available real-time data pipelines to ingest, store, and query large volumes of structured and semi-structured AI usage data.
- Collaborate closely with product engineers to ship polished, end-to-end features that solve real problems for our customers, such as:
  - Bundling and uploading javascript and python code snippets to be used as online, on-demand function calls for LLM workflows.
  - Support for parsing and uploading attachments from LLM multimodal outputs into long term storage.
  - Role-based access controls and data retention policies for enterprise use cases.

## Ideal candidate credentials

- 5+ years of backend engineering experience across multiple parts of the stack
- Strong systems thinking: you’ve owned or contributed to infrastructure projects and know how to design for scale, uptime, and data integrity
- Proficient in modern backend technologies (e.g., **Node.js**, **Go**, **Python**, **Rust**, **Postgres**, **Redis**, **Terraform**, **Docker**, **AWS**)
- Experience with observability tooling (e.g., **Grafana**, **Prometheus**, **Datadog**, or similar) and a passion for making systems operable, available and rock solid.
- Comfortable with ambiguous problems and excited to partner across the company to ship impactful work
- Clear communicator who documents decisions, shares context, and helps lift the team

## Similar roles

- [Software Engineer (Backend), Deliverability](https://hotfix.jobs/jobs/2784834d-42ef-4b0d-bb3c-b825cbae7c53) - Front - San Francisco, CA - $178k – $204k/yr
- [Backend Engineer](https://hotfix.jobs/jobs/b1af6614-7e82-451b-b33a-6e7723bb589c) - Scribe - San Francisco, CA - $140k – $185k/yr
- [Software Engineer, Codex -Enterprise Controls](https://hotfix.jobs/jobs/9fc148ac-afcb-4558-a41e-a772e8869a71) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer III](https://hotfix.jobs/jobs/a91a8070-ade4-411a-a538-be8c46e121ab) - ZoomInfo - Bethesda, MD - $112k – $176k/yr
- [Software Engineer, Upstart Bank](https://hotfix.jobs/jobs/5dbad557-7d4b-47a1-a575-68c16e632c5f) - Upstart - Remote - $14k – $187k/yr

**Apply:** https://hotfix.jobs/jobs/1900766d-65df-441f-98c5-4f65225c85b0
**Canonical:** https://hotfix.jobs/jobs/1900766d-65df-441f-98c5-4f65225c85b0