Skip to content

Senior Software Engineer, Data Centralization & Storage

178k – 206kUnited StatesRemote5+ YOE
Summary

Senior Software Engineer focused on architecting and scaling high-throughput data platforms for analytics, AI/ML, and centralized storage using Java, Spark, Flink, Kafka, and modern data lake technologies.

About the role

What You’ll Accomplish

  • Architect high-throughput solutions that power our most critical operations, ensuring scalability and efficiency.
  • Expand and enhance our self-service platform, collaborating with cross-functional teams to fuel our AI, ML, and analytics goals.
  • Tackle complex distributed data challenges, streamline system integrations, and uphold high standards of quality and governance.
  • Champion cutting-edge technologies, keeping our platform at the forefront of industry advancements and enabling strategic outcomes.
  • Unify data from diverse systems, paving the way for experimentation and innovation while empowering teams with intuitive tools and frameworks.

Your Expertise

  • Track record of debugging issues across layers—from application logic to infrastructure bottlenecks—and understand the tradeoffs in system design.
  • Proven experience as a Software Engineer with a focus on high throughput scalable systems.
  • In-depth knowledge of high throughput processing technologies such as Spark, Flink, and/or Kafka.
  • Proficiency in Java and strong understanding of object-oriented design, data structures, algorithms, and optimization.
  • Development experience working with data warehouse tools like Snowflake, Clickhouse, Trino, etc.
  • Experience with open source data storage formats such as Apache Iceberg, Parquet, Arrow, or Hudi.
  • Knowledgeable about data modeling, data access, and data replication techniques, such as CDC.
  • Proven track record of architecting applications at scale and maintaining infrastructure as code via Terraform.
  • Excited by new technologies but conscious of choosing them for the right reasons.

What We Use

  • Backend: Java / Spring Boot microservices, Gradle, DynamoDB, Pulsar, Flink, Spark, Postgres, Planetscale, Redis, AWS.
  • Frontend: React, TypeScript, GraphQL, Storybook, Radix UI, Vite, esbuild, Playwright.
Skills
JavaSpring BootSparkFlinkKafkaSnowflakeClickHouseTrinoApache IcebergParquetApache HudiTerraformAWSDynamoDBPulsar
Similar roles at this salary range
All Data Engineering jobs →
Headway

Staff Data Infrastructure Engineer

Staff-level Data Infrastructure Engineer to architect and evolve the data platform (Snowflake, ingestion, orchestration, CI/CD, AWS infra) serving analytics, product, and ML teams. Requires 10+ years building scalable data platforms and proven technical leadership.

212k – 265kNew York, NY +2Data EngineeringHybrid10+ YOEAWSSQL
Headway

Senior Manager, Data Engineering

Lead and scale Headway's data engineering team, owning architecture for data warehouse, pipelines, dbt transformations, and orchestration to power analytics, ML, and operations. Requires 8+ years data engineering experience and 3+ years managing teams.

212k – 265kNew York, NY +2Data EngineeringHybrid8+ YOEdbtData Modeling
Jellyfish

Staff Data Engineer

Staff Data Engineer to define architecture and build scalable data pipelines, integrations, and workflow orchestration systems. Requires deep Python expertise, IaC fluency, and technical leadership across AI-driven data infrastructure.

200k – 260kUnited StatesData EngineeringRemote7+ YOECI/CDPython
Airbnb

Senior Software Engineer, Data Infrastructure

Design, build, and operate Airbnb's next-generation big data compute platform using Spark, Trino, and related technologies. Requires 5+ years of data infrastructure experience and strong distributed systems expertise.

191k – 225kUnited StatesData EngineeringRemote5+ YOEHiveJava
Pinecone

Senior Data Platform Engineer

Senior Data Platform Engineer to own ingestion, transformation, orchestration, and metrics layers powering business analytics. Requires 4+ years building production data pipelines with strong SQL, BigQuery, Airflow/Kubernetes, and AI coding tools experience.

176k – 200kNew York, NYData EngineeringHybrid4+ YOESQLDBT