# Principal Software Engineer, Data Engineering

**Company:** [Highspot](https://hotfix.jobs/companies/highspot)
**Location:** Seattle, WA
**Role:** Data Engineering
**Experience:** 8+ years
**Skills:** Snowflake, Apache Kafka, Apache Flink, Cdc, Debezium, AWS, Terraform, Python, Java, SQL, MongoDB, DynamoDB
**Posted:** 2026-06-15

> Principal Data Engineer to architect and lead a scalable data platform serving analytics, reporting, and AI workloads from unified foundations. Requires 8+ years building production data pipelines with Snowflake, Kafka, Flink, and strong Python/Java/SQL skills.

## Job Description

## What You'll Do

- Architect the data platform – drive the technical direction for a scalable, reliable data platform built on a medallion architecture that serves customer-facing analytics, reporting, and agentic AI from a unified foundation.
- Build and optimize ingestion pipelines – design robust CDC, real-time streaming (Kafka, Flink), and batch processing pipelines that transform complex, nested document-oriented operational data into clean analytical models at enterprise scale.
- Tame schema complexity – build resilient ingestion and transformation layers that gracefully handle deeply nested, continuously evolving document schemas — deciding where to absorb complexity (ingestion, transformation, or query time) and making those tradeoffs explicit and sustainable.
- Serve AI and analytics consumption patterns – architect data products that support both traditional BI workloads (pre-aggregated dashboards, dimensional models for scorecards and reports) and emerging AI consumption patterns (low-latency retrieval, contextual assembly, freshness-sensitive agent queries).
- Own data quality, contracts, and observability – establish the data trust infrastructure that makes cross-team data consumption reliable: schema contracts with upstream producers, data quality monitoring, lineage tracking, freshness SLAs, and clear escalation paths when things break.
- Drive cost-aware architecture – own Snowflake warehouse optimization, compute governance, and cost-efficient pipeline design. Build the practices and visibility so the team makes principled cost/performance tradeoffs rather than discovering them on the invoice.
- Bridge producers and consumers – collaborate across organizational boundaries to align upstream software engineering teams and downstream analytics and AI teams around unified data strategies, shared contracts, and engineering standards.
- Lead and grow the team – technically lead and growth-coach a diverse crew of data engineers. Champion best practices across the full spectrum of data engineering disciplines, from low-level pipeline architecture to sophisticated data modeling and analytical query performance.

## Your Background

**What will set you apart:**
- Demonstrated depth in building production data platforms that serve multiple consumption patterns – you've gone beyond traditional BI to support real-time product features, AI/ML workloads, or customer-facing analytics from the same data foundation.
- Deep experience with the impedance mismatch between document-oriented operational stores and analytical systems – you've dealt with nested, schema-evolving source data (MongoDB, DynamoDB, or similar) and have opinions on where flattening and transformation should live.
- Hands-on experience with data quality and trust at scale – you've built or operated schema registries, data contracts, quality monitoring, or lineage systems in an environment where multiple teams depend on shared data products.
- Track record of cost-conscious data architecture – you've optimized Snowflake (or comparable) warehouse spend, designed compute governance policies, or re-architected pipelines to materially reduce cost without sacrificing reliability.
- Strong instinct for the bridge role: you're as comfortable pushing back on an upstream team's schema change as you are negotiating freshness SLAs with a downstream AI consumer.

**Foundations:**
- 8+ years of professional software engineering experience, with significant time spent on distributed, data-intensive production systems – including substantial depth in data pipeline and platform architecture.
- Deep hands-on expertise with modern data technologies: Snowflake, Apache Kafka, Apache Flink, and CDC tooling (Debezium or similar).
- Experience developing and operating cloud data infrastructure at enterprise scale (AWS preferred), including infrastructure-as-code (Terraform) and CI/CD automation.
- Strong programming skills in Python, Java, and SQL. You write production-grade code, not just scripts.
- A track record of designing performant data models that support fast, efficient querying for analytical and product-facing use cases.
- Strong cross-functional communication skills - you work effectively with software engineers, data scientists, AI teams, and business stakeholders across organizational boundaries.
- Experience mentoring engineers and building collaborative, high-performing teams.

## Similar roles

- [Principal Software Engineer - Data Engineering & Streaming Primitives](https://hotfix.jobs/jobs/da2e9255-69a5-4627-9401-6b5672024b6f) - Snowflake - Bellevue, WA - $264k – $380k/yr
- [Principal Data Engineer](https://hotfix.jobs/jobs/e449b7a0-6100-4029-9753-512bac67acb2) - Upside - Remote - $215k – $250k/yr
- [Senior/Principal Data Engineer](https://hotfix.jobs/jobs/b5bc31d7-f54b-41ee-9287-b2c62b4b1845) - Waymark - Remote - $124k – $206k/yr
- [Principal Java Data Engineer](https://hotfix.jobs/jobs/4ff48445-b6ff-46ac-a2fa-dbe53b799ed9) - PointClickCare - Remote - $183k – $203k/yr
- [Principal Software/Data Engineer](https://hotfix.jobs/jobs/3ec6f9e7-050f-4de1-8f9c-4c062714bf3d) - PointClickCare - Remote - $183k – $204k/yr

**Apply:** https://hotfix.jobs/jobs/1417b985-e318-467e-a7c3-cf83e9ce96f6
**Canonical:** https://hotfix.jobs/jobs/1417b985-e318-467e-a7c3-cf83e9ce96f6