Staff Software Engineer, Data Infrastructure
Leads the design and delivery of scalable data infrastructure, services, and developer tooling while shaping technical direction and mentoring engineers. Requires 8+ years of software engineering experience, strong systems design expertise, and proficiency in a modern programming language.
About the job
Responsibilities
- Guide complex initiatives from requirements gathering and robust system design through deployment.
- Evaluate dependent technologies and collaborate with stakeholders.
- Build scalable data infrastructure and improve the developer experience, including data cataloging, versioning, and lineage.
- Provide technical guidance to engineering and research staff.
- Mentor and support the growth of teammates.
- Help define the team’s technical roadmap and strategic engineering goals.
Requirements
- Bachelor’s degree in Computer Science or Engineering, or equivalent experience.
- 8+ years of relevant software engineering experience.
- Proven software design and implementation experience focused on correctness, robustness, efficiency, and scale.
- Experience with large codebases and modular, extensible, maintainable software.
- Expertise in a modern programming language such as Python, Go, Java, or C++.
- Hands-on Linux/UNIX development experience.
- Experience designing scalable services and APIs, highly available systems, and/or large-scale data infrastructure.
- Experience with data storage and management technologies.
- Strong communication skills and ability to explain complex ideas clearly.
Nice-to-haves
- Kubernetes and Docker.
- Iceberg, BigQuery, Snowflake, DynamoDB, or Trino/Athena.
- Data platforms, developer-focused APIs, access patterns, or infrastructure-abstraction tooling.
- Airflow or Slurm.
Compensation and Benefits
- ATS-listed compensation range: $295,000–$400,000.
- Competitive compensation and benefits packages.
- Technology talks, modern office, and daily catered lunches.
Skills
Python, Go, Java, C++, Linux, Unix, Postgres, Artifactory, Ceph, Redis, Kubernetes, Docker, BigQuery, Snowflake, Airflow
Similar jobs
Data Engineering jobs
Anthropic
San Francisco, CABuild and operate the data foundations behind AI safeguards, including production pipelines, data stores, governance controls, and internal tooling. The role requires strong Python and SQL skills, production data-platform experience, and expertise in reliable, privacy-conscious systems across multiple cloud environments.
Vercel
San Francisco, CAStaff Data Platform Engineer leading the architecture and development of financial data infrastructure for revenue reporting, billing, forecasting, and compliance. Requires 8+ years of data engineering or architecture experience, strong streaming and warehouse expertise, and the ability to mentor engineers and partner with Finance and Audit leaders.
Vanta
Remote
Leads the re-platforming of Vanta’s compliance data layer from MongoDB to schema-aware PostgreSQL across high-throughput Kafka and S3 pipelines. The role requires staff-level distributed systems expertise, migration leadership, and strong experience with relational and document data modeling.
Anyscale
San Francisco, CA
Staff Software Engineer responsible for designing and scaling Ray Data’s distributed data-processing infrastructure for large-scale AI training and inference. Requires 6+ years of production software and architectural ownership experience, plus deep distributed-systems expertise and strong Python skills.
Haus
San Francisco, CAStaff-level engineer leading backend services and data-platform architecture, including large-scale ingestion, distributed systems, and trustworthy BigQuery/dbt warehouse models. Requires 10+ years of software engineering experience, expert Python, deep SQL/dbt expertise, and strong technical leadership.