Staff Software Engineer – Logs Observability Pipelines
Staff engineer builds and scales high-throughput log processing pipelines for customer-managed infrastructure, focusing on observability data routing and storage. Requires expertise in distributed systems, systems programming (Go/Rust/C++), Kubernetes, and cloud platforms.
About the job
What You’ll Do
- Drive the architecture and technical direction for unifying observability pipelines and on-prem observability storage into a cohesive BYOC Logs experience
- Build and scale high-throughput systems for log processing, routing, and transformation across distributed environments
- Lead cross-team initiatives, aligning engineers, product managers, and stakeholders to deliver complex, multi-team projects
- Design and implement software that runs reliably within customer-managed infrastructure, including on-prem and cloud environments
- Improve system performance, scalability, and cost efficiency through thoughtful trade-off analysis and capacity planning
- Contribute hands-on to critical code paths, debugging, and deployment challenges in customer environments
Who You Are
- Experience building and operating software deployed in customer-managed or on-prem environments, not just SaaS platforms
- Strong expertise in distributed systems, including scalability, performance optimization, and high-throughput data processing
- Proficient in systems-level programming (Go, Rust, or C++) and understand how software runs across diverse environments (Linux systems)
- Experience with cloud platforms (AWS, Azure, or GCP) and comfortable troubleshooting infrastructure and networking issues
- Experienced with containerization and orchestration technologies such as Kubernetes in production environments
- Track record of leading large, cross-functional engineering efforts and influencing technical direction across teams
Skills
Go, Rust, C++, Kubernetes, AWS, Azure, GCP, Linux, Distributed Systems
Similar jobs
Backend Engineering jobs
Fivetran
Oakland, CA
Leads the design and implementation of scalable distributed data pipelines and related infrastructure, while improving performance, reliability, and security. Requires 5+ years of software experience, systems programming expertise, cloud and containerization experience, and senior staff-level technical leadership.
Fivetran
Oakland, CA
Leads performance engineering for high-volume data systems by diagnosing bottlenecks, designing improvements, and building resilient performance platforms. Requires 10+ years of software experience, strong Java and database expertise, and experience with distributed backend systems.
Snowflake
Menlo Park, CA
Staff Software Engineer on Snowflake’s Snowtrail team, designing and operating query-processing and distributed infrastructure that improves engineering velocity and production quality. Requires expertise in databases, query optimization, compiler implementation, and large-scale systems.
Axion
New York, NYStaff Software Engineer leading backend and data-intensive systems, including scalable services, AI-powered workflows, cloud infrastructure, and reliability initiatives. Requires 8+ years of software engineering experience and expertise in distributed systems, data processing, and containerized applications.
Carta
San Francisco, CA
Staff Engineer responsible for the long-term technical health and strategic direction of Carta’s Middle Office domain, including distributed systems, architecture, reliability, and AI-enabled engineering practices. Requires 10+ years of software engineering experience and demonstrated technical leadership across teams.