# Staff Software Engineer - Databases, Tempo

**Company:** [Grafana Labs](https://hotfix.jobs/companies/grafana-labs)
**Location:** Remote
**Role:** Backend Engineering
**Experience:** 7+ years
**Skills:** Go, Rust, C, C++, Distributed Systems, Ingestion Pipelines, Storage Engines, Query Execution, Traceql, OpenTelemetry, Parquet, Kubernetes, SLOs, Ai Assistants, LLMs
**Posted:** 2026-07-29

> Leads architecture and delivery of complex distributed data-system initiatives for Tempo, Grafana’s open-source tracing backend. The role requires deep production systems experience, strong software craftsmanship, operational ownership, and technical leadership across multiple teams.

## Job Description

## Responsibilities
- Lead multi-quarter technical initiatives from problem framing through rollout, including trace aggregation APIs, autoscaling cells, customer limits, and query engine improvements.
- Own the architecture of core Tempo components: ingestion, storage, query, and metrics generation.
- Drive design reviews and make trade-offs across performance, cost, and complexity; document architectural decisions.
- Design structured, deterministic, discoverable APIs for humans, agents, downstream products, and external integrators.
- Drive operational excellence through SLO ownership, automation, parameterized rollouts, actionable alerts, and toil reduction.
- Partner with Product and sibling teams to understand and unblock downstream product needs.
- Mentor engineers through code review, design feedback, pairing, and technical writing.
- Participate in on-call, incident response, and post-incident learning.
- Contribute to the open-source Tempo project, review external contributions, and engage the community.

## Requirements
- Track record of leading complex, multi-quarter initiatives spanning design, delivery, and operations.
- Substantial hands-on experience building and operating distributed data systems in production, such as ingestion pipelines, storage engines, or query execution systems.
- Strong software craftsmanship and experience writing clean, robust, performant, maintainable software.
- Strong Go experience, or deep experience in Rust, C, or C++ with a path to Go.
- Experience owning production services, carrying a pager, reducing toil, and working with SLOs.
- Customer-focused and pragmatic approach with short feedback loops, MVP delivery, and iterative improvement.
- Clear communication through design documents, reviews, and shipped code in a fully remote, asynchronous environment.

## Nice-to-haves
- Experience with tracing, OpenTelemetry, or large-scale observability systems.
- Experience designing query languages, SQL- or TraceQL-like engines, or programmatic APIs for services and agents.
- Experience with columnar storage formats such as Parquet or purpose-built on-disk analytical formats.
- Experience operating multi-tenant, multi-cell SaaS infrastructure at scale on Kubernetes.
- Experience building systems for AI and large language model consumers.

## Compensation and Benefits
- Company-funded usage budget for AI coding assistants.
- Access to frontier AI models, including GPT-5.6, Claude Fable, and Gemini Pro 3.1.

## Similar jobs

- [Staff Software Engineer](https://hotfix.jobs/jobs/1c1c4d74-9822-4ad9-84fe-efdf89104398) - Anaconda - Remote
- [Staff Backend Engineer](https://hotfix.jobs/jobs/127bb501-4fd5-435d-92d9-d47c9bf13f75) - GitLab - Remote - $153k – $259k/yr
- [Staff Backend Software Engineer](https://hotfix.jobs/jobs/41554d1a-6807-41a8-a723-5f32747834db) - Addepar - Edinburgh, United Kingdom
- [Staff Engineer, Test Integration, Modelling and Simulation](https://hotfix.jobs/jobs/7d0534d4-2344-4fc4-97d8-732f5ec3fa07) - Shield AI - London, United Kingdom
- [Staff Software Engineer, Backend](https://hotfix.jobs/jobs/0971f827-acba-45c6-b582-7ed16106c518) - Nango - Remote - $140k – $220k/yr

**Apply:** https://hotfix.jobs/jobs/fa5c45a5-1d86-408d-93b0-02d5a9bcc675
**Canonical:** https://hotfix.jobs/jobs/fa5c45a5-1d86-408d-93b0-02d5a9bcc675