# Software Engineer, Backend
**Company:** [Braintrust](https://hotfix.jobs/companies/braintrust)
**Location:** New York, NY, Seattle, WA
**Experience:** 5+ years
**Skills:** Node.js, Go, Python, Rust, Postgres, Redis, Terraform, Docker, AWS, Grafana, Prometheus, Datadog
**Posted:** 2025-05-27
> Build scalable backend infrastructure for AI observability platform, including real-time data pipelines, LLM integrations with OpenAI/Anthropic/Gemini, and open-source tracing libraries. Requires 5+ years backend experience with Node.js/Go/Python, Postgres/Redis, AWS, and observability tools.
## Job Description
## What you'll do

- Design and ship features that give users deep insight into their LLM usage and performance.
- Integrate, proxy, cache, and collect data from OpenAI, Anthropic, Gemini, and other major model providers that our customers rely on.
- Develop and evolve robust, efficient open source libraries for tracing and evaluating LLM calls inside customer applications.
- Build highly available real-time data pipelines to ingest, store, and query large volumes of structured and semi-structured AI usage data.
- Collaborate closely with product engineers to ship polished, end-to-end features that solve real problems for our customers, such as:
  - Bundling and uploading javascript and python code snippets to be used as online, on-demand function calls for LLM workflows.
  - Support for parsing and uploading attachments from LLM multimodal outputs into long term storage.
  - Role-based access controls and data retention policies for enterprise use cases.

## Ideal candidate credentials

- 5+ years of backend engineering experience across multiple parts of the stack
- Strong systems thinking: you’ve owned or contributed to infrastructure projects and know how to design for scale, uptime, and data integrity
- Proficient in modern backend technologies (e.g., **Node.js**, **Go**, **Python**, **Rust**, **Postgres**, **Redis**, **Terraform**, **Docker**, **AWS**)
- Experience with observability tooling (e.g., **Grafana**, **Prometheus**, **Datadog**, or similar) and a passion for making systems operable, available and rock solid.
- Comfortable with ambiguous problems and excited to partner across the company to ship impactful work
- Clear communicator who documents decisions, shares context, and helps lift the team
**Apply:** https://hotfix.jobs/jobs/software-engineer-backend-at-braintrust-1900766d-65df-441f-98c5-4f65225c85b0
**Canonical:** https://hotfix.jobs/jobs/software-engineer-backend-at-braintrust-1900766d-65df-441f-98c5-4f65225c85b0