Skip to content
CrusoeCrusoeSan Francisco, CA

Senior Software Engineer, Streaming (Backend Engineer)

Senior Streaming Software Engineer building and operating high-throughput real-time data pipelines and streaming platforms (Kafka, Flink etc.) for observability, logs, metrics and traces across Crusoe's large-scale AI GPU cloud and data centers. Requires strong distributed systems and backend engineering experience.

209k – 253k/yr
On-site5+ YOEData Engineering

About the role

What You’ll Be Working On

  • Designing, building, and maintaining streaming services and pipelines that ingest and process observability data including logs, metrics, traces, and operational events
  • Implementing real-time data processing systems using technologies such as Kafka, Kinesis, Pub/Sub, Flink, or similar streaming platforms
  • Scaling streaming infrastructure to support high-throughput telemetry ingestion, high-cardinality workloads, and bursty infrastructure traffic patterns
  • Ensuring streaming systems are reliable and observable, with strong instrumentation, dashboards, and alerting
  • Collaborating with SREs and platform teams to integrate streaming data into internal observability tools and operational workflows
  • Participating in on-call rotations, incident response, and post-incident reviews
  • Improving system reliability and developer experience through automation, CI/CD, and infrastructure-as-code practices
  • Contributing to technical design discussions and reviews for new streaming capabilities

What You’ll Bring to the Team

  • Strong experience building and operating distributed systems, especially streaming or real-time data platforms
  • Hands-on experience with Kafka or similar distributed streaming technologies
  • Proficiency in backend languages such as Java, Scala, Go, or Python
  • Experience operating services in cloud or large-scale infrastructure environments
  • Solid understanding of observability fundamentals including metrics, logging, tracing, and alerting
  • Comfort debugging production issues across distributed systems
  • Ability to own features end-to-end, from design through production operations
  • Strong collaboration skills and a pragmatic engineering mindset

Bonus Points

  • Experience building observability platforms at cloud or data center scale
  • Familiarity with stream processing frameworks and delivery semantics
  • Experience with Kubernetes and containerized infrastructure
  • Exposure to schema management, data contracts, or serialization formats
  • Experience working with bare-metal infrastructure or large-scale data center environments
  • Interest in mentoring junior engineers

Benefits

  • Industry competitive pay
  • Restricted Stock Units in a fast growing, well-funded technology company
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Subscription to the Calm app
  • MetLife Legal
  • Company paid commuter benefit; $300 per month

Compensation

Compensation will be paid in the range of $209,000 - $253,000 + Bonus. Restricted Stock Units are included in all offers. Compensation to be determined by the applicant’s education, experience, knowledge, skills, and abilities, as well as internal equity and alignment with market data.

Skills

KafkaJavaScalaGoPythonKubernetesFlinkkinesisPub/SubDistributed SystemsObservability
Zoox

Senior Data Engineer

ZooxFoster City, CA

Build self-healing data ingestion pipelines and integration layers for enterprise systems (SAP, Salesforce, Workday) to deliver AI-ready data for autonomous agents and analytics. Requires 8+ years building production ETL/ELT pipelines with Python, SQL, and orchestration tools.

206k – 247k/yrHybrid8+ YOEData Engineering
Headway

Senior Manager, Data Engineering

HeadwayNew York, NY +2

Lead and scale Headway's data engineering team, owning architecture for data warehouse, pipelines, dbt transformations, and orchestration to power analytics, ML, and operations. Requires 8+ years data engineering experience and 3+ years managing teams.

212k – 265k/yrHybrid8+ YOEData Engineering
Anthropic

Finance Systems Integration Engineer

AnthropicSan Francisco, CA +1

Build and maintain integrations between ERP and financial systems (Workato/MuleSoft, APIs) while expanding into Claude-powered AI agents and data pipelines (Airflow, dbt, BigQuery) for a fast-growing AI company. Requires 8+ years in integration/data engineering, strong Python/JS skills, and ERP/finance domain knowledge.

205k – 270k/yrHybrid8+ YOEData Engineering
Formation Bio

Senior Data Engineer - Real World Data

Formation BioNew York, NY +2

Senior Data Engineer building scalable pipelines to transform EHR and claims data into analytics-ready assets while conducting hands-on real-world evidence analyses. Requires 5+ years experience with 2+ years in healthcare data, strong SQL/Python, Snowflake/dbt/Dagster, and familiarity with OMOP and causal inference frameworks.

205k – 267k/yrHybrid5+ YOEData Engineering
Retell AI

Senior Language Engineer

Retell AIRedwood City, CA

Own end-to-end high-quality dataset creation pipelines for voice AI agents, from data synthesis and scraping to annotation workforce management, cleaning, analysis, and linguistic preference judgment. Requires 2+ years in computational linguistics or language data, strong scripting skills, and native English linguistic judgment.

200k – 290k/yrOn-site2+ YOEData Engineering