Principal Engineer, Streaming Systems
Leads development of high-throughput streaming systems handling millions of messages per second with sub-second latency for real-time behavioral data processing and AI personalization. Requires expertise in distributed systems architecture, scaling infrastructure, and leading complex projects.
About the job
Responsibilities
- Lead work on high-throughput systems that collect, forward, and perform realtime computation on billions of behavioral events.
- Build infrastructure that ingests clickstream, product interaction, and transactional data.
- Preserve <1s end-to-end system latency at throughput over 1,000,000 messages/second.
- Improve caching strategies for online computation service.
- Architect system to deduplicate message delivery at 1,000,000 messages/second.
- Develop patterns for elegant and zero-downtime deployments in online computation service.
- Own and deliver projects from start to finish, work directly with customers on scaling problems, influence technical roadmap.
Requirements
- Experienced in architecting, building, deploying, and maintaining distributed systems at scale.
- Experience leading highly complex and ambitious projects.
- Ability to mentor and up-level engineers.
- Passion for solving hard technical problems with high ownership in fast-paced startup environment.
- Strong opinions on engineering best practices to scale a growing team.
Compensation
- Base salary: $180,000 - $320,000 USD per year (location independent).
- Large portion in equity via ISO options (early exercise, 10-year post-termination window).
Skills
Distributed Systems, Streaming Systems, Caching, System Architecture, Real-Time Computation, High-Throughput Systems, Zero-Downtime Deployments, Data Ingestion, Clickstream Processing, Snowflake, Databricks
Similar jobs
Backend Engineering jobs
ZoomInfo
Bethesda, MDLeads the design and implementation of distributed advertising, identity, and intent systems processing billions of events in real time. The role requires deep backend, data infrastructure, or applied AI/ML experience, strong programming and data modeling skills, and technical leadership.
Vanta
United States
Leads the architecture and phased delivery of an enterprise organizational model spanning tenancy, data isolation, permissions, audits, and residency requirements. Requires 15+ years of backend engineering experience and a record of driving complex initiatives across teams.
Payabli
Remote
Founding senior engineer responsible for creating and operating Payabli’s Payments Core infrastructure, including ledgers, exactly-once money movement, multi-rail orchestration, settlement, and reconciliation. Requires 12+ years of production payments or financial-systems experience at major scale.
Redis
United States
Leads technical vision, architecture, and V2 development of Redis Feature Store for large-scale ML infrastructure. Requires 8+ years backend experience, expertise in Python/Go/Rust, cloud platforms, and data tools; mentors team and engages enterprise customers.
Fetch
United States
Principal engineer responsible for the architecture, scalability, reliability, and long-term technical strategy of Fetch’s advertising platform. The role requires deep distributed-systems expertise, production experience with high-volume backend systems, and hands-on technical leadership across organizations.