Skip to content
ArenaArenaSan Francisco, CA

Senior Software Engineer, Data Infrastructure

Build and scale data pipelines to process millions of user votes for AI model evaluation. Partner with researchers to deliver insights via dashboards, ensuring data quality and reliability in a fast-paced environment. Requires 5+ years in data engineering with big data tools.

Salary not listed
Hybrid5+ YOEData Engineering

About the role

Responsibilities

  • Design and build robust data pipelines to ingest, process, and transform user vote data to features essential for model performance evaluation.
  • Collaborate with researchers and product leadership to understand product goals and necessary data.
  • Design and implement solutions to generate result dashboards and reports, providing useful information for the public, model providers, and researchers.
  • Ensure the integrity, data quality, and reliability of the pipelines.
  • Scale our data infrastructure to accommodate increasing data volumes and evolving analytical needs.

Requirements

  • 5+ years of experience in software engineering, with a dedicated focus on data engineering and big data technologies.
  • Proficiency in SQL and at least one programming language commonly used for data analysis (Python (preferred), Scala, R).
  • Hands-on experience with data processing and pipeline frameworks (Apache Spark, Ray Data, etc.) and at least one popular big data analytics platform (Databricks, Snowflake).
  • Demonstrated experience in designing, implementing, optimizing, and debugging production data pipelines.

Preferred Qualifications

  • Prior work in data analytics or datalake platforms.
  • Experience in advanced data analysis tools, such as Delta Lake, streaming tables.
  • Exposure to machine learning is a plus.

Skills

SQLPythonSparkRay DataDatabricksSnowflakeDelta LakeScalaR
HappyRobot

Data Operations Lead

HappyRobotSan Francisco, CA

Lead data operations for AI audio models at HappyRobot. Translate research needs into data specs, manage end-to-end acquisition/annotation with internal and vendor teams, optimize tooling/workflows, and scale labeling operations to deliver high-quality datasets on time.

180k – 240k/yr
Hybrid5+ YOEData Engineering
Ambient.ai

Senior Software Engineer, AI Data Systems & Database Infrastructure

Ambient.aiRedwood City, CA

Senior Platform Engineer designing, building, and scaling database infrastructure for production and AI systems, including relational, analytical, and vector stores. Requires 7+ years experience with distributed systems, high-availability databases, and supporting AI workloads like vector search and RAG.

168k – 205k/yr
Hybrid7+ YOEData Engineering
Vanta

Senior Data Engineer

VantaUnited States

Senior Data Engineer responsible for designing and deploying scalable data infrastructure, orchestration models, and analytics tooling to enable data-driven decisions, ML products, and enterprise reporting at Vanta. Requires 4+ years data experience, software engineering mindset, modern data stack proficiency, and passion for secure, compliant data systems.

190k – 224k/yr
Remote4+ YOEData Engineering
Cloudflare

Senior Data Engineer

CloudflareAustin, TX

Senior Data Engineer building scalable data pipelines, services, and AI-ready data layers in Go/Scala/ClickHouse to power internal products, analytics, and agentic AI for go-to-market, engineering, and product teams. Requires 5+ years experience in production data systems, strong programming, SQL, and databases.

Salary not listed
On-site5+ YOEData Engineering
Trexquant

Senior Data Engineer

TrexquantStamford, CT +1

Senior Data Engineer responsible for building scalable ingestion pipelines, normalizing, and maintaining large-scale financial and alternative datasets from global vendors to support quantitative research and alpha generation. Requires 5+ years data engineering experience in finance/quant environments, strong Python/SQL/Linux skills, and deep knowledge of market/tick/reference data across asset classes.

150k – 200k/yr
On-site5+ YOEData Engineering