Skip to content
xAIxAIPalo Alto, CA

Software Engineer

Build and operate realtime and batch data pipelines processing billions of events daily at xAI. Design distributed data platforms, own data correctness, create shared datasets for product and business teams, and partner on data acquisition using tools like Spark, Kafka, Flink, and SQL.

125k – 400k
On-site3+ YOEData Engineering

About the role

Responsibilities

  • Design, build, and operate production-grade realtime and batch pipelines that ingest, process, validate, and deliver data powering user-behavior insights and product decisions.
  • Create shared datasets, fact tables, and internal data products that let other teams analyze, debug, and improve product performance.
  • Prototype and build tooling that automates and accelerates internal data workflows — backfills, dashboards, report generation, and self-serve access to data.
  • Own data correctness end to end: validate with output invariants, denominator reconciliation, and independent recomputation, and lead root-cause investigations when key metrics move unexpectedly.
  • Move fluidly across query engines and frameworks (e.g., BigQuery, Trino, Clickhouse for analytics; Flink, Kafka, Spark/Scalding for streaming and batch), choosing the right tool and adapting quickly to new infrastructure and environments.
  • Partner across product and business teams to surface where data gaps exist and prioritize the highest-impact opportunities for new data acquisition and improvement.
  • Iterate quickly on feedback, shipping the smallest useful increment with a strong bias toward efficient, accurate, and reliable solutions.

Requirements

  • 3+ years of professional software engineering experience, ideally in data engineering or distributed systems.
  • Hands-on expertise in Python, Rust, Scala, Go or Java, and data pipeline toolings and distributed systems.
  • Knowledge of realtime and batch data processing tools such as Spark/Kafka/Flink/SQL and various storage systems in RMDBs/NoSQL.
  • Experience solving large scale problems and comfortable doing incremental quality work while building brand new systems to enable future quality improvements.
  • Proven records of interpreting product requirements into engineering implementation plans, and effectively communicating with different groups (AI, product, marketing/sales and engineering).

Compensation and Benefits

  • $125,000 - $400,000 USD total compensation (base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks).

Skills

PythonRustScalaGoJavaSparkKafkaFlinkSQLBigQueryTrinoClickHouseDistributed SystemsData Pipelines
Axle

Bioinformatics Engineer

AxleRockville, MD

Develop and optimize Nextflow-based bioinformatics pipelines for high-throughput sequencing analysis on Google Cloud Platform. Requires 3+ years of production pipeline experience, Nextflow proficiency, and strong genomics analysis skills.

125k – 150k
On-site3+ YOEData Engineering
Applied Intuition

Data & ML Pipeline Software Engineer

Applied IntuitionSunnyvale, CA

Builds large-scale data processing pipelines and ML infrastructure to automate data curation, model training, and iteration for autonomous vehicles using real-world and simulation data. Requires 3-5 years experience in data/ML infra, Python, and frameworks like Spark/Airflow/Kafka.

125k – 222k
On-site3+ YOEData Engineering
Permitflow

Analytics Engineer

PermitflowNew York, NY

Builds and maintains scalable data pipelines, models, and warehouses to enable business intelligence and decision-making. Collaborates with teams on data integration, governance, and self-serve analytics using SQL, dbt, Python, and BI tools. Requires 3+ years experience.

125k – 215k
Hybrid3+ YOEData Engineering
Pinterest

Software Engineer II, Big Data, tvScientific

PinterestSan Francisco, CA

Design and implement scalable data infrastructure using Spark/Scala on AWS. Build data pipelines, knowledge graphs, and APIs to support a high-growth CTV advertising platform.

124k – 255k
RemoteData Engineering
Brex

Data Engineer

BrexSan Francisco, CA

Build and maintain scalable data models, pipelines, and Core Data tables to transform raw data into actionable insights. Collaborate with data scientists and business teams using SQL, DBT, Snowflake, Airflow, and Python.

121k – 151k
Hybrid3+ YOEData Engineering