# Senior Software Engineer, Data Infrastructure

**Company:** [Decagon](https://hotfix.jobs/companies/decagon)
**Location:** San Francisco, CA, New York, NY
**Role:** Data Engineering
**Salary:** $200k – $400k/yr
**Experience:** 5+ years
**Skills:** Kafka, Apache Flink, Apache Airflow, ClickHouse, BigQuery, Terraform, GitOps, OpenTelemetry, Prometheus, Grafana, Datadog, Debezium, Kubernetes, Spark, dbt
**Posted:** 2026-08-24

> Senior Data Infrastructure Engineer responsible for building and operating reliable, low-latency streaming and batch data systems that support AI products. Requires 5+ years of production data infrastructure experience and expertise with technologies such as Kafka, Flink, ClickHouse, and Terraform.

## Job Description

## Responsibilities
- Design and implement high-throughput data pipelines and streaming systems with strong SLOs, runbooks, and actionable telemetry.
- Build and operate real-time and batch ingestion infrastructure using Kafka, Flink, and Airflow.
- Own the analytical data layer, including schema design, query performance, and cost optimization across ClickHouse, BigQuery, or similar systems.
- Partner with research and product teams to architect data solutions, evaluate performance, and scale new features.
- Optimize pipeline and query latency through caching, partitioning, and data-path improvements to meet tight p95/p99 targets.
- Lead infrastructure-as-code and GitOps practices for data systems using Terraform, reusable modules, and policy-as-code.
- Participate in on-call and reduce operational toil through automation and elimination of recurring data issues.

## Requirements
- 5+ years building and operating production data infrastructure at scale.
- Hands-on experience with ClickHouse, Kafka or equivalent messaging systems, and Flink or dbt.
- Proven ability to meet high-availability and low-latency targets across streaming and batch workloads.
- Strong observability and incident-response experience.
- Clear written communication and ability to turn ambiguous data requirements into reliable designs.

## Nice-to-haves
- CDC experience with Debezium.
- Experience with Airflow, Dagster, or Prefect.
- Familiarity with Spark or Dask for large-scale data processing.
- Experience with Snowflake, BigQuery, Redshift, or Databricks.
- Early data, platform, or infrastructure engineering experience at another company.
- Strong Kubernetes experience with GKE, EKS, or AKS.
- Multi-cloud experience across Google Cloud, AWS, or Azure.
- Experience with customer-managed deployments.

## Compensation and Benefits
- $200,000–$400,000 base salary plus equity.
- Medical, dental, and vision benefits.
- Life insurance and disability benefits.
- Retirement plan.
- Parental leave.
- Fertility and family-building benefits.
- Monthly wellness and lifestyle stipend.
- Daily office lunches and snacks.
- Flexible vacation policy.

## Similar jobs

- [Senior Software Engineer, Data Platform](https://hotfix.jobs/jobs/49af38a0-1567-4b29-b4cd-abc6eb545270) - Discord - Remote - $196k – $245k/yr
- [Senior Software Engineer, Data Platform](https://hotfix.jobs/jobs/9cd7ae61-c6cd-4460-9c6f-a1a5d7a6c558) - Harvey - San Francisco, CA - $193k – $290k/yr
- [Senior Data Engineer - Revenue Data Platform](https://hotfix.jobs/jobs/45d58880-5ca7-4439-90d9-df10c3ff385c) - Datadog - Boston, MA - $192k – $240k/yr
- [Senior Market Data Engineer](https://hotfix.jobs/jobs/7a7351b1-fce8-4e13-b093-701b72df6c47) - Coinbase - Remote - $191k – $225k/yr
- [Senior Data Engineer](https://hotfix.jobs/jobs/1a4cfa68-20d5-4ca3-8cdd-deca4de5e129) - Plaid - New York, NY - $191k – $239k/yr

**Apply:** https://hotfix.jobs/jobs/2c3e5efe-6f60-4a27-b7ec-1795674ea20d
**Canonical:** https://hotfix.jobs/jobs/2c3e5efe-6f60-4a27-b7ec-1795674ea20d