Staff Software Engineer, Data
Build scalable data infrastructure to ingest and process millions of hardware telemetry data points per second. Requires 7+ years in data engineering, streaming systems like Flink/Kafka, databases like PostgreSQL/Druid, and languages like Go/Rust/Python.
About the job
Responsibilities
- Design and build a horizontally scalable platform for ingesting millions of hardware sensor data points per second
- Develop durable, efficient database solutions to support real-time reads and large-scale analytics workloads
- Pioneer data architecture by integrating recent innovations in streaming and storage, including cloud-native and diskless designs
- Help define engineering culture, standards, and processes
- Collaborate closely with peers on architecture, design, code reviews, and scaling strategies
Requirements
- Bachelor's degree in Computer Science, Engineering, Physics, or another STEM discipline
- 7+ years of experience in backend, infrastructure, or data engineering roles
- Hands-on experience with event-time-based stream processing or streaming SQL systems using tools like Apache Flink, Kafka Streams, Beam, or similar
- Proficiency with relational and time-series databases like PostgreSQL, Druid, Pinot, TimescaleDB, or equivalent
- Experience with large-scale distributed systems or low-latency backend services, ideally written in Go, Rust, or Python
- Familiarity with DevOps and cloud infrastructure tools such as Kubernetes, Prometheus, ArgoCD, and Terraform
- Strong communication skills and a collaborative approach to problem-solving
Nice-to-Haves
- Familiarity with telemetry data from hardware systems, high-throughput ingest pipelines, or columnar storage formats like Apache Arrow and Parquet
- Experience building resilient, performant systems that scale to billions of records
- Curiosity about new data paradigms and eagerness to evaluate and integrate emerging tools and techniques
Compensation
- Salary range: $200,000 - $250,000 per year
- Plus equity and benefits
Skills
Apache Flink, Kafka Streams, Apache Beam, Postgres, Druid, Pinot, Timescaledb, Go, Rust, Python, Kubernetes, Prometheus, Argo CD, Terraform, Apache Arrow
Similar jobs
Data Engineering jobs
Airbnb
United States
Staff Software Engineer leading design and development of large-scale batch and real-time data pipelines and ML infrastructure to power GenAI/LLM products and features for Airbnb's Messaging, Notifications, and Connectivity organization. Requires 9+ years experience building production ML systems and cross-functional collaboration.
Coinbase
United States
This staff-level data engineer will architect and operate low-latency market data infrastructure, including feed handling, normalization, distribution, and exchange connectivity. The role requires at least five years of backend engineering experience and strong Java or C++ expertise with high-throughput messaging and market data protocols.
Databricks
New York, NY
Leads large-scale advertising data ingestion, measurement, and agentic workflow systems, combining deep ad-tech expertise with production LLM experience. Requires 10+ years of engineering experience and technical and people leadership in complex enterprise environments.
Commure
Mountain View, CAStaff Software Engineer responsible for architecting, building, and operating Commure’s data warehouse platform, including CDC, lakehouse, query, transformation, and analytics layers. Requires 6+ years of software engineering experience and broad expertise across modern production data infrastructure.
Axion
San Francisco, CASenior individual contributor responsible for architecting and scaling production data ingestion systems that integrate complex enterprise sources into reliable datasets. Requires 5+ years of backend engineering experience, strong Python, cloud, Kubernetes, Postgres, and data integration expertise.