Skip to content

Principal Engineer - Agentic Data Plane

245k – 290kSan Francisco, CABackend EngineeringRemote10+ YOE
Summary

Architects and builds Agentic Data Plane for AI agents to securely interact with enterprise data in real-time. Tracks AI research, prototypes capabilities, defines architectures, engages customers, and acts as technical ambassador. Requires 10+ years in distributed systems and agentic AI infrastructure.

About the role

Responsibilities

  • Track emerging research, frameworks, and industry developments in the agentic AI space, and translate the most relevant signals into concrete engineering proposals and product bets
  • Identify, prototype, and deliver high-leverage emerging capabilities for ADP, in partnership with the broader team
  • Define architectural patterns for new ADP capabilities, ensuring they integrate cleanly with the existing runtime, policy, and observability layers
  • Engage directly with strategic customers and the field to stress-test new capabilities against real enterprise deployment scenarios
  • Serve as a technical ambassador for ADP externally, publishing research, writing engineering blog posts, and speaking at conferences to establish Redpanda's credibility at the frontier of agentic infrastructure
  • Participate in on-call and help drive down operational toil, improving system observability and self-healing capabilities over time

Requirements

  • 10+ years of software engineering experience, with a demonstrated track record of leading the design and delivery of complex, large-scale distributed systems
  • Experience building or contributing to emerging areas of agentic AI infrastructure, e.g. eval frameworks, orchestration layers, context management, AI gateways, or similar
  • Fluency with AI-assisted development at the level of agentic orchestration, i.e. composing multi-agent coding workflows with subagents to dramatically accelerate research and prototyping
  • Deep expertise in at least one systems language (Go preferred) and comfort working across the stack
  • Understanding of streaming data systems, messaging infrastructure, or data plane/control plane architectures, experience with Apache Kafka or Redpanda is a plus
  • Experience designing and operating systems that enforce access control, policy, and auditability at scale
  • Self-directed, strong written communicator, comfortable collaborating asynchronously in GitHub, Slack, and Google Docs
  • Excellent interpersonal and communication skills. Able to lead without authority across engineering teams and engage credibly with technical customers and external audiences

Nice to Have

  • Familiarity with AI safety, alignment, or responsible AI research as it applies to autonomous systems in enterprise environments
  • Experience with protocol buffers, protoreflect and codegen
  • Background in security, identity, or data governance systems relevant to enterprise environments
  • Experience running Kafka/Redpanda and/or Postgres at scale
  • Experience with Kubernetes and cloud-native infrastructure across AWS, GCP, or Azure
  • Prior experience in an early-stage or growth-stage startup, especially in a category-defining product area

Compensation

U.S. base salary range for this role is $245,000 - $290,000. Salary ranges are determined by role, level, and location.

Skills
GoApache KafkaRedpandaKubernetesdistributed systemsagentic AIAI orchestrationprotocol buffersPostgresAWS
Similar roles at this salary range
All Backend Engineering jobs →
Zoox

Senior/Staff Software Engineer - C++ Simulation Platform

Build and optimize the high-speed GPU-based C++ simulation platform that powers Zoox's autonomous vehicle ML training and validation at scale.

245k – 305kFoster City, CA +1Backend EngineeringHybrid6+ YOEC++JAX
Confluent

Staff Software Engineer I

Staff-level engineer building multi-tenant, highly available storage infrastructure for Tableflow, focusing on table materialization, compaction, and background maintenance at massive scale.

261k – 307kUnited StatesBackend EngineeringRemote7+ YOEAWSAzure
Otter

Staff Software Engineer, Backend (Infrastructure)

Lead architecture and development of scalable backend infrastructure supporting AI products. Requires 10+ years building large-scale web services with Python, Django, and distributed systems expertise.

210k – 275kMountain View, CABackend EngineeringHybrid10+ YOEAWSMySQL
Crusoe

Staff Engineer, Command Center Insights & Actions

Staff Engineer owning detection systems for Crusoe's Command Center platform. Defines heuristics, thresholds, and anomaly detection rules that translate infrastructure telemetry into actionable signals. Ships production features in Go/Rust/C++/Java with 5+ years experience.

210k – 255kSan Francisco, CABackend EngineeringOn-site5+ YOEGoC++
Airbnb

Staff Software Engineer (Technical Lead), Storage

Lead engineering efforts on Airbnb's critical KV stores, caching, and data ingestion platforms. Architect and scale high-performance distributed storage systems while mentoring teams and influencing long-term technical strategy.

204k – 255kUnited StatesBackend EngineeringRemote9+ YOERedisKafka