# Software Engineer, Data Infrastructure

**Company:** [Datology AI](https://hotfix.jobs/companies/datology-ai)
**Location:** Redwood City, CA
**Role:** Data Engineering
**Salary:** $180k – $300k/yr
**Skills:** Spark, Flink, Snowflake, Hive, SQL, Hdfs, S3, Airflow, Dagster, Python, Scala, Java, ETL
**Posted:** 2025-03-20

> Builds and maintains scalable data processing pipelines and backend systems for a data curation platform that optimizes training data for ML models. Partners with researchers to integrate research capabilities, ensuring reliability and security for customer data.

## Job Description

## What You'll Work On
- Design, build and maintain highly scalable data processing solutions, while ensuring scalability, reliability, and security
- Architect, build, and deploy the back-end systems and services that power our data curation platform
- Partner with researchers and engineers to bring new features and research capabilities to our customers
- Ensure that our systems are reliable, secure, and worthy of our customers' trust

## About You
- Have meaningful experience with leading and building production data systems to deliver on major product initiatives
- You have built and managed highly scalable data processing solutions (e.g. Spark, Flink), data lakes or warehouses (e.g. Snowflake, Hive), authored queries (SQL), distributed storage systems (e.g., HDFS, S3), used workflow management (e.g. Airflow, Dagster), and have experience maintaining the infra that supports these
- Proficiency in at least one programming language commonly used within Data Engineering, such as Python, Scala, or Java
- Expertise with any of ETL schedulers such as Airflow, Dagster, or similar frameworks
- Experience maintaining a high quality bar for design, correctness, and testing
- Take pride in building and operating scalable, reliable, secure systems
- Have a humble attitude, an eagerness to help your colleagues, and a desire to do whatever it takes to make the team succeed
- Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done
- You have experience being the technical lead of a Data Engineering / Platform / Infrastructure Team
- Experience building ML/DL systems and/or data infrastructure that feeds into training large ML models

## Compensation
- Base salary ranges from $180,000 to $300,000
- Comprehensive benefits: 100% covered health benefits (medical, vision, dental), 401(k) with 4% company match, unlimited PTO, annual wellness stipend ($2,000), learning stipend ($1,000), daily lunches/snacks, relocation assistance

## Similar roles

- [Data Engineer](https://hotfix.jobs/jobs/6b412eb4-37c6-4c36-8f77-10e86bc79c93) - Actively AI - New York, NY - $180k – $210k/yr
- [Data Engineer](https://hotfix.jobs/jobs/7443d425-2ed8-49a3-9b59-ee77171cd7d0) - Baseten - San Francisco, CA - $180k – $250k/yr
- [Software Engineer - Data Platform](https://hotfix.jobs/jobs/f6588639-59ab-484a-9fab-418122ada203) - xAI - Palo Alto, CA - $180k – $440k/yr
- [Software Engineer, Distributed Data Systems](https://hotfix.jobs/jobs/515ee00c-9aa9-4052-8be3-d18af7f2ea6a) - Exa - San Francisco, CA - $180k – $350k/yr
- [Data Engineer](https://hotfix.jobs/jobs/d5dae85f-a730-436c-a9e7-adb1ca41470d) - Airtable - San Francisco, CA - $180k – $222k/yr

**Apply:** https://hotfix.jobs/jobs/cfc2b08d-e49a-4d20-a3f4-2f4fffbd8b88
**Canonical:** https://hotfix.jobs/jobs/cfc2b08d-e49a-4d20-a3f4-2f4fffbd8b88