Skip to content

Software Engineer II, Big Data, tvScientific

124k – 255kSan Francisco, CARemote
Summary

Design and implement scalable data infrastructure using Spark/Scala on AWS. Build data pipelines, knowledge graphs, and APIs to support a high-growth CTV advertising platform.

About the role

What you'll do

  • Design and implement robust data infrastructure in AWS, using Spark with Scala
  • Evolve core data pipelines to efficiently scale for massive growth
  • Store data in optimal engines and formats, matching designs to performance needs and cost factors
  • Collaborate with cross-functional teams to design data solutions that meet business needs
  • Design and implement knowledge graphs, exposing their functionality both via Batch Processing and APIs
  • Leverage and optimize AWS resources while designing for scale
  • Collaborate closely with Data Science and Product teams

How we'll define success

  • Successful design and implementation of scalable and efficient data infrastructure
  • Timely delivery and optimization of data assets and APIs
  • High attention to detail in implementation of automated data quality checks
  • Effective collaboration with cross-functional teams

What we're looking for

  • Production data engineering experience
  • Proficiency in Spark and Scala, with proven experience building data infrastructure in Spark using Scala preferred
  • Experience in delivering significant technical initiatives and building reliable, large scale services
  • Experience in delivering APIs backed by relationship-heavy datasets
  • Familiarity with data lakes, cloud warehouses, and storage formats
  • Strong proficiency in AWS services
  • Expertise in SQL for data manipulation and extraction
  • Excellent written and verbal communication skills
  • Bachelor's degree in Computer Science or a related field
  • Demonstrated ability to use AI to improve speed and quality in day-to-day workflow
  • Strong track record of critical evaluation and verification of AI-assisted work
  • High integrity and ownership

Nice-to-haves

  • Experience in adtech
  • Experience implementing data governance practices, including data quality, metadata management, and access controls
  • Strong understanding of privacy-by-design principles and handling of sensitive or regulated data
  • Familiarity with data table formats like Apache Iceberg, Delta
  • Previous experience building out a Data Engineering function
  • Proven experience working closely with Data Science teams on machine learning pipelines
Skills
SparkScalaAWSSQLData LakesApache IcebergDelta LakeData PipelinesAPIsKnowledge Graphs
Similar roles at this salary range
All Data Engineering jobs →
Loop Financial

Analytics Engineer

Build and own core data models, ETL pipelines, and analytics infrastructure to enable data-driven decisions across the company and clients. Requires 2+ years building analytical products, strong SQL/Python, and modern data stack experience.

135k – 155kChicago, ILData EngineeringOn-siteSQLdbt
Turquoise Health

Data Science Engineer, Analytics

Build data pipelines, models, dashboards, and analyses to support product and business decision-making. Requires 2+ years of Python/SQL experience with data modeling, ETL tools, and AWS.

145k – 160kSan Diego, CAData EngineeringRemoteSQLdbt
Stuut

Data Engineer

Stuut is seeking a Data Engineer to build and own their data infrastructure from the ground up. This foundational role involves designing pipelines, data models, and implementing DataOps best practices to transform financial data into actionable insights.

135k – 190kSan Francisco, CA +1Data EngineeringOn-siteSQLdbt
Dropbox

Data Engineer, Analytics Data Engineering

As a Data Engineer, you will build large, scalable analytics pipelines from the ground up using modern data technologies. You will define data assets, design integrations, and optimize data processing systems.

133k – 202kUnited StatesData EngineeringRemoteC++SQL
Twilio

Software Engineer L3 Data Substrate

As a Software Engineer on the Data & Analytics Platform team, you will design, build, and optimize the data platform to support various data-driven initiatives. You will work with cross-functional teams to architect scalable solutions and implement data infrastructure using modern data technologies.

139k – 204kUnited StatesData EngineeringRemoteHiveHudi