Staff Software Engineer - Data Ingestion
Build and scale data ingestion platforms, pipelines, APIs, and processing products that move billions of rows across a multi-tenant system. The role requires 8+ years of software development experience and strong expertise in large-scale application architecture.
About the job
Responsibilities
- Develop high-quality software using technologies such as Python, Apache Kafka, Iceberg, and Temporal.
- Create data pipelines and processing products at large scale.
- Build scalable data platforms, data lakes, and data ingestion systems.
- Own one or more products, APIs, or platform areas.
- Solve challenging technical problems and develop engineering expertise across multiple areas.
- Influence company-wide architecture, technology selection, and engineering trends.
Requirements
- 8+ years of software development experience, preferably in fast-paced, dynamic environments.
- Strong understanding of computer science fundamentals, architectures, and design patterns.
- Proven experience building large-scale applications, APIs, and developer tools.
- Excellent cross-functional collaboration and ability to explain technical concepts to non-technical partners.
- Product-focused mindset and passion for improving customer experience.
Nice-to-haves
- Contributions to open-source projects such as Apache Iceberg, Parquet, Spark, Hive, Flink, Delta Lake, Presto, Trino, or Avro.
Compensation
- Salary range of $189,000-$315,000, plus benefits and equity.
Skills
Python, Apache Kafka, Apache Iceberg, Temporal, Data Pipelines, Data Lakes, Apache Parquet, Spark, Apache Flink, Delta Lake, Presto, Trino, Apache Avro
Similar jobs
Data Engineering jobs
Databricks
New York, NY
Leads large-scale advertising data ingestion, measurement, and agentic workflow systems, combining deep ad-tech expertise with production LLM experience. Requires 10+ years of engineering experience and technical and people leadership in complex enterprise environments.
Webflow
United States
Staff Data Engineer leading data platform initiatives across batch, streaming, real-time pipelines, data lake infrastructure, governance, and privacy. Requires 5+ years of data engineering experience, strong Spark and distributed processing expertise, and the ability to lead complex production systems.
IntusCare
United States
Staff-level engineer responsible for the technical direction, reliability, and evolution of a cloud ELT platform supporting healthcare data products. The role requires 7+ years of software or data engineering experience, deep SQL/Python and modern data-platform expertise, and strong architectural and mentoring leadership.
Rula
United States
Leads organization-wide Snowflake migration, Medallion architecture, warehouse optimization, and CI/CD quality controls while partnering with executives on data strategy. The role requires 6+ years in analytics or data engineering, expert SQL, production dbt experience, and strong architectural judgment.
SmithRx
United States
Leads enterprise data engineering strategy, architecture, delivery, governance, and technical leadership across the organization. Requires extensive data engineering experience, advanced data modeling and warehouse expertise, and strong PySpark, SQL, and Python skills.