# Sr. Data Engineer - US (Remote)

**Company:** [Luxury Presence](https://hotfix.jobs/companies/luxury-presence)
**Location:** Remote
**Role:** Data Engineering
**Salary:** $150k – $190k/yr
**Experience:** 6+ years
**Skills:** Python, Pyspark, Spark Streaming, Kafka, Airflow, Iceberg, AWS, Kubernetes, Pydantic, SQS
**Posted:** 2026-04-10

> Senior Data Engineer builds and scales high-throughput streaming pipelines for real estate data using Spark, Kafka, and Airflow on AWS. Requires 6+ years experience, strong Python skills, and daily AI integration in workflows.

## Job Description

## What You'll Do
- Build and scale high-throughput streaming pipelines. Design, implement, and operate pipelines ingesting 400M+ monthly MLS updates across 350+ integrations using **Airflow**, **Spark Streaming**, **Kafka**, and **Iceberg**—ensuring reliability, performance, and data correctness.
- Model and deliver high-quality, production-grade real estate datasets. Develop and maintain datasets that power core product experiences, with a focus on data modeling, transformation logic, and balancing freshness, accuracy, and cost.
- Strengthen data quality and observability. Implement and improve data quality checks, monitoring, and alerting to detect issues early and reduce downstream impact.
- Leverage AI to improve data operations. Contribute to AI-driven tooling that helps triage, debug, and resolve data quality issues, increasing team efficiency and reducing manual intervention.

## What We're Looking For
### Attributes
- You already build with AI daily. You use Claude Code as a core part of your workflow, not as a novelty
- You have strong opinions, loosely held, about how AI changes software architecture, team structure, and engineering culture
- You think in systems. You connect technical decisions to customer outcomes and long-term business value
- You communicate clearly and directly. You can explain complex tradeoffs to product, design, and executive stakeholders
- You're energized by ambiguity and speed. You thrive in a fast-growing company where the roadmap evolves and ownership is real
- You like to have fun at work. We take our craft seriously, but we don't take ourselves too seriously. We celebrate wins, crack jokes, and genuinely enjoy building together

### Skills and Experience
- 6+ years of professional data engineering or software engineering experience
- Strong experience with distributed data processing and streaming systems (**Spark** / **PySpark**, **Kafka**)
- Proficiency in **Python** (**Pydantic** preferred) and familiarity with **Node/TypeScript** is a plus
- Experience building and maintaining data pipelines on **AWS** using tools like **Airflow**, **Spark Streaming**, and **Iceberg**
- Solid understanding of data modeling and working with large-scale datasets
- Familiarity with event-driven systems and ingestion patterns (**Kafka**, **SQS**)
- Experience implementing data quality checks, monitoring, and debugging data issues
- Interest in applying AI/ML or automation to improve data workflows is a plus
- Proven track record leading high-impact initiatives from concept through production in a SaaS environment
- Expert-level grasp of software design principles and experience with multi-tenant platform architectures

### Tech Stack
**Backend:** Python, PySpark, Pydantic, Node/TypeScript  
**Data:** Iceberg, Postgres  
**Infrastructure:** AWS, Kubernetes, Airflow, Spark Streaming  
**Messaging:** Kafka, SQS

## Similar roles

- [Senior Data Engineer](https://hotfix.jobs/jobs/298b05d6-eba7-413d-bb1d-948ca80c669a) - Trexquant - Stamford, CT - $150k – $200k/yr
- [Senior Data and AI Platform Engineer](https://hotfix.jobs/jobs/adeca831-cf66-4980-b857-657118a0fbf1) - Jellyfish - Remote - $150k – $230k/yr
- [Senior Analytics Engineer](https://hotfix.jobs/jobs/4d96efe9-ab20-47be-97a4-62d25d2ac601) - Talkiatry - Remote - $150k – $175k/yr
- [Senior Data Engineer, Public Sector](https://hotfix.jobs/jobs/900bf0dc-909b-40b1-ae9b-8fb33f7bb208) - Scale AI - Washington, DC - $150k – $259k/yr
- [Senior Data Engineer](https://hotfix.jobs/jobs/f738d9a0-51f4-40a6-9c2b-1dd75bcd83c1) - Fetch - Remote - $150k – $207k/yr

**Apply:** https://hotfix.jobs/jobs/67e907c6-a22c-4e6f-978b-9d8c2dda1e65
**Canonical:** https://hotfix.jobs/jobs/67e907c6-a22c-4e6f-978b-9d8c2dda1e65