Skip to content
Luxury PresenceLuxury PresenceUnited States

Sr. Data Engineer - US (Remote)

Senior Data Engineer builds and scales high-throughput streaming pipelines for real estate data using Spark, Kafka, and Airflow on AWS. Requires 6+ years experience, strong Python skills, and daily AI integration in workflows.

150k – 190k
Remote6+ YOEData Engineering

About the role

What You'll Do

  • Build and scale high-throughput streaming pipelines. Design, implement, and operate pipelines ingesting 400M+ monthly MLS updates across 350+ integrations using Airflow, Spark Streaming, Kafka, and Iceberg—ensuring reliability, performance, and data correctness.
  • Model and deliver high-quality, production-grade real estate datasets. Develop and maintain datasets that power core product experiences, with a focus on data modeling, transformation logic, and balancing freshness, accuracy, and cost.
  • Strengthen data quality and observability. Implement and improve data quality checks, monitoring, and alerting to detect issues early and reduce downstream impact.
  • Leverage AI to improve data operations. Contribute to AI-driven tooling that helps triage, debug, and resolve data quality issues, increasing team efficiency and reducing manual intervention.

What We're Looking For

Attributes

  • You already build with AI daily. You use Claude Code as a core part of your workflow, not as a novelty
  • You have strong opinions, loosely held, about how AI changes software architecture, team structure, and engineering culture
  • You think in systems. You connect technical decisions to customer outcomes and long-term business value
  • You communicate clearly and directly. You can explain complex tradeoffs to product, design, and executive stakeholders
  • You're energized by ambiguity and speed. You thrive in a fast-growing company where the roadmap evolves and ownership is real
  • You like to have fun at work. We take our craft seriously, but we don't take ourselves too seriously. We celebrate wins, crack jokes, and genuinely enjoy building together

Skills and Experience

  • 6+ years of professional data engineering or software engineering experience
  • Strong experience with distributed data processing and streaming systems (Spark / PySpark, Kafka)
  • Proficiency in Python (Pydantic preferred) and familiarity with Node/TypeScript is a plus
  • Experience building and maintaining data pipelines on AWS using tools like Airflow, Spark Streaming, and Iceberg
  • Solid understanding of data modeling and working with large-scale datasets
  • Familiarity with event-driven systems and ingestion patterns (Kafka, SQS)
  • Experience implementing data quality checks, monitoring, and debugging data issues
  • Interest in applying AI/ML or automation to improve data workflows is a plus
  • Proven track record leading high-impact initiatives from concept through production in a SaaS environment
  • Expert-level grasp of software design principles and experience with multi-tenant platform architectures

Tech Stack

Backend: Python, PySpark, Pydantic, Node/TypeScript
Data: Iceberg, Postgres
Infrastructure: AWS, Kubernetes, Airflow, Spark Streaming
Messaging: Kafka, SQS

Skills

PythonPysparkSpark StreamingKafkaAirflowIcebergAWSKubernetesPydanticSQS

Similar roles

Data Engineering jobs
Trexquant

Senior Data Engineer

TrexquantStamford, CT +1

Senior Data Engineer responsible for building scalable ingestion pipelines, normalizing, and maintaining large-scale financial and alternative datasets from global vendors to support quantitative research and alpha generation. Requires 5+ years data engineering experience in finance/quant environments, strong Python/SQL/Linux skills, and deep knowledge of market/tick/reference data across asset classes.

150k – 200k
On-site5+ YOEData Engineering
Jellyfish

Senior Data and AI Platform Engineer

JellyfishUnited States

Senior individual contributor building and leading Jellyfish's Databricks Lakehouse platform to power enterprise analytics, BI, agentic AI workflows, and data science. Requires deep data platform engineering experience, strong Databricks expertise, Python/SQL skills, and ability to deliver governed, production-grade data foundations for AI.

150k – 230k
Remote7+ YOEData Engineering
Talkiatry

Senior Analytics Engineer

TalkiatryUnited States

Builds and maintains scalable data models and pipelines using Snowflake, dbt, and Databricks to support analytics for patient intake funnel. Leads BI solutions, self-service tools, and best practices with 5+ years experience, advanced SQL, and cross-functional collaboration.

150k – 175k
Remote5+ YOEData Engineering
Scale AI

Senior Data Engineer, Public Sector

Scale AIWashington, DC

Build analytical and BI infrastructure for Scale's Public Sector unit. Develop scalable data pipelines, models, warehouses, and quality tests from ambiguous processes to enable decision-making; requires 5+ years experience, SQL mastery, Python/R, DBT, and active Secret clearance.

150k – 259k
On-site5+ YOEData Engineering
Fetch

Senior Data Engineer

FetchUnited States

Senior Data Engineer building scalable batch and real-time data pipelines, feature stores, and low-latency serving systems to power Fetch's recommendation and audience targeting ML models. Requires 6+ years experience with Spark, Kafka, Flink, cloud infrastructure, and close collaboration with ML and backend teams.

150k – 207k
Remote6+ YOEData Engineering