Staff Backend Engineer - Grafana Second Horizon
Build and operate production backend services for an AI-native enterprise context layer, including ingestion, storage, retrieval APIs, and agent integrations. The role requires staff-level architectural ownership, cloud-native experience, LLM and GenAI application expertise, and comfort working autonomously in an ambiguous early-stage environment.
About the job
Responsibilities
- Design, implement, test, and operate backend services for context ingestion, indexing, retrieval orchestration, API access, source configuration, and system administration.
- Define and build a scalable multi-tenant SaaS foundation, including tenant isolation, usage tracking, quotas, audit logs, background jobs, and reliable service boundaries.
- Build APIs and service interfaces for AI agents, MCP tools, CLIs, and internal applications to retrieve context, provenance, confidence signals, and warnings.
- Balance rapid experimentation with long-term reliability as the project progresses from prototype to production.
- Instrument services with metrics, logs, traces, alerts, and dashboards; use observability tools to understand system behavior and improve reliability.
- Shape architecture, service boundaries, storage choices, API contracts, deployment patterns, and engineering practices.
- Communicate effectively and contribute across teams.
- Own AI solutions through scalable, maintainable implementation aligned with user workflows.
Requirements
- Strong experience building production-grade, user-facing software systems.
- Familiarity with AI technologies and frameworks, with a practical delivery mindset.
- Experience with rapid prototyping, experimentation, feedback collection, and iteration.
- Ability to take initiative, define scope in ambiguous situations, and drive projects forward.
- Strong collaboration and communication skills.
- Experience with LLMs, prompt engineering, and GenAI-powered applications.
- Proven experience delivering software to production and active users.
- Experience in cloud-native environments such as AWS, GCP, or Azure.
- Experience using observability tools to understand and troubleshoot system behavior.
Nice-to-haves
- Experience with agent frameworks or multi-agent workflows.
- Experience as a data analyst or with data platforms such as Looker, Tableau, Power BI, Snowflake, or Databricks.
- Experience building tools for data engineering.
Compensation and Benefits
- Spain base compensation range: EUR 94,025–112,830.
- Restricted Stock Units (RSUs) are included with all roles.
- Compensation ranges and benefits are country-specific.
Skills
Python, LLMs, Prompt Engineering, Generative AI, Agent Frameworks, Mcp, AWS, GCP, Microsoft Azure, Multi-Tenancy, REST APIs, Observability, Metrics, Distributed Systems, Snowflake
Similar jobs
Backend Engineering jobs
Vanta
Remote
Leads architecture and technical strategy for Vanta’s government compliance product, building scalable backend systems and new workflows in a 0-to-1 environment. Requires 10+ years of backend experience, strong systems thinking, cross-functional influence, and a track record of mentoring engineers.
Anaconda
United StatesStaff Software Engineer leading the production toolchain for compiling and distributing complex Python packages across Linux, macOS, and Windows. Requires 10+ years of software development experience and deep C/C++ expertise in compilation, linking, architecture, and technical strategy.
Stripe
Barcelona, Spain
Leads the technical strategy and hands-on delivery of scalable backend and UI platform capabilities supporting merchant-facing experiences across web and mobile interfaces. Requires 10+ years building APIs or distributed systems and a record of cross-team technical leadership.
Datadog
Lisbon, PortugalLeads the design and delivery of shared distributed-platform capabilities for cost intelligence, operational tooling, reliability, and developer experience. The role requires deep backend and systems expertise with Java, Go, Kafka, and Kubernetes, plus technical leadership across multiple engineering teams.
MongoDB
Dublin, Ireland
Build and lead large-scale distributed backend features for MongoDB Atlas and Atlas Data Federation & Archiving. The role requires 10+ years of software development experience, compiled-language expertise, cloud-provider experience, and production ownership.