# Senior/Staff Software Engineer (Data Platform)

**Company:** [Actively AI](https://hotfix.jobs/companies/actively-ai)
**Location:** San Francisco, CA
**Role:** Data Engineering
**Salary:** $140k – $210k/yr
**Experience:** 5+ years
**Skills:** Python, SQL, dbt, BigQuery, Snowflake, Pub/Sub, Kafka, Airflow, Fivetran, Dataflow
**Posted:** 2026-04-28

> Builds and scales data pipelines, transformations, and infrastructure powering real-time AI agents. Handles ingestion from CRM, transcripts, and signals into agent-ready data, ensuring freshness, reliability, and low-latency at scale for millions of accounts. Requires 5+ years in data systems.

## Job Description

## What You’ll Do

- Own the ingestion and transformation layer. Design and scale pipelines that pull structured and unstructured data from CRM systems, call transcripts, and external signals, normalizing and enriching it into representations agents can reason over in real time.
- Build for operational use, not just analytics. The data you produce doesn't power dashboards; it powers decisions. Freshness, accuracy, and low-latency access matter here in ways they don't in a typical data warehouse.
- Keep data current as the world changes. Architect real-time and mini-batch workflows using technologies like **Pub/Sub**, **Kafka**, or modern ETL tools to ensure data stays synchronized as customer activity happens.
- Solve for customer-specific variation at scale. Every customer has their own CRM configuration, field naming, and business logic. You'll build transformation systems that stay consistent and correct across all of them without becoming brittle.
- Own reliability end to end. Observability, lineage, schema management, alerting; you define what \"trust in the data\" means and make sure it holds across thousands of accounts, so agents and other teams can confidently build on top of it.
- Work across the full stack. **Python**, **SQL**, **DBT**, **BigQuery**, **Snowflake** and move between layers fluidly, contributing wherever the work needs it.

## Who You Are

- Deep roots in data systems, not just data tooling. You have **5+ years** designing and operating core data infrastructure from ingestion and transformation to serving and observability in high-growth environments where the data needed to be right, fresh, and fast.
- Built for agents and models, not just reports. You've worked on data systems that power **ML models**, intelligent workflows, or real-time decisioning. You understand the different demands that put on infrastructure compared to a typical analytics stack.
- Fluent across the modern data stack. Proficient in **Python**, **SQL**, and **DBT**, with hands-on experience in **BigQuery** or **Snowflake**, and familiar with orchestration tools like **Fivetran**, **Airflow**, or **Polytomic**.
- Fluent in real-time infrastructure. You've built streaming and mini-batch pipelines using **Pub/Sub**, **Kafka**, **Dataflow**, or similar technologies, and understand the trade-offs between latency, throughput, and operational complexity.
- Startup-proven or product-platform experience. You've either built a data platform from scratch at an early-stage company or worked at a data-focused product company (e.g. **Segment**, **dbt Labs**) scaling systems across many customers.
- Self-directed and accountable for quality. You take work from design to production without being managed through it, and you hold yourself responsible for whether the data your systems produce is actually trustworthy.

## Nice to Haves

- Prior experience at a data infrastructure or platform company (e.g. **Segment**, **Databricks**, **Confluent**, **Fivetran**) or meaningful contributions to open-source data tooling.
- Familiarity with embedding and vector pipelines like chunking strategies, index management, and keeping representations in sync with fast-changing source data.
- Experience building data pipelines where correctness was a hard requirement like financial data, compliance systems, or other domains where bad data has real downstream consequences.

## Compensation

**$140,000—$210,000 USD**

## Similar roles

- [Manager, Data Engineering](https://hotfix.jobs/jobs/c3aa5db8-887b-4a1a-a118-0def9d35fc19) - Skillable - Remote - $140k – $185k/yr
- [Staff Engineer, Operations Analysis (R4757)](https://hotfix.jobs/jobs/ab643b15-ee39-462a-b946-b29a1f7a1693) - Shield AI - Dallas, TX - $150k – $220k/yr
- [Staff Data Engineer, tvScientific](https://hotfix.jobs/jobs/e5393edc-62b5-41bd-a456-9a536d8d11ec) - Pinterest - Remote - $156k – $320k/yr
- [Senior/Staff Software Engineer (Data Platform)](https://hotfix.jobs/jobs/be6690d2-f09c-4863-b3bf-a5360b5c80d5) - Actively AI - New York, NY - $120k – $220k/yr
- [Senior/Staff Software Engineer, ML Data Infrastructure](https://hotfix.jobs/jobs/eb88d3a3-1030-45d0-8464-ebd768d41579) - Nuro - Mountain View, CA - $160k – $241k/yr

**Apply:** https://hotfix.jobs/jobs/53664acb-d6f1-49a4-9056-cb7e4b811fbe
**Canonical:** https://hotfix.jobs/jobs/53664acb-d6f1-49a4-9056-cb7e4b811fbe