Skip to content
PinterestPinterestSan Francisco, CA

Software Engineer II, Big Data, tvScientific

Design and implement scalable data infrastructure using Spark/Scala on AWS. Build data pipelines, knowledge graphs, and APIs to support a high-growth CTV advertising platform.

124k – 255k
RemoteData Engineering

About the role

What you'll do

  • Design and implement robust data infrastructure in AWS, using Spark with Scala
  • Evolve core data pipelines to efficiently scale for massive growth
  • Store data in optimal engines and formats, matching designs to performance needs and cost factors
  • Collaborate with cross-functional teams to design data solutions that meet business needs
  • Design and implement knowledge graphs, exposing their functionality both via Batch Processing and APIs
  • Leverage and optimize AWS resources while designing for scale
  • Collaborate closely with Data Science and Product teams

How we'll define success

  • Successful design and implementation of scalable and efficient data infrastructure
  • Timely delivery and optimization of data assets and APIs
  • High attention to detail in implementation of automated data quality checks
  • Effective collaboration with cross-functional teams

What we're looking for

  • Production data engineering experience
  • Proficiency in Spark and Scala, with proven experience building data infrastructure in Spark using Scala preferred
  • Experience in delivering significant technical initiatives and building reliable, large scale services
  • Experience in delivering APIs backed by relationship-heavy datasets
  • Familiarity with data lakes, cloud warehouses, and storage formats
  • Strong proficiency in AWS services
  • Expertise in SQL for data manipulation and extraction
  • Excellent written and verbal communication skills
  • Bachelor's degree in Computer Science or a related field
  • Demonstrated ability to use AI to improve speed and quality in day-to-day workflow
  • Strong track record of critical evaluation and verification of AI-assisted work
  • High integrity and ownership

Nice-to-haves

  • Experience in adtech
  • Experience implementing data governance practices, including data quality, metadata management, and access controls
  • Strong understanding of privacy-by-design principles and handling of sensitive or regulated data
  • Familiarity with data table formats like Apache Iceberg, Delta
  • Previous experience building out a Data Engineering function
  • Proven experience working closely with Data Science teams on machine learning pipelines

Skills

SparkScalaAWSSQLData LakesApache IcebergDelta LakeData PipelinesAPIsKnowledge Graphs

Similar roles

Data Engineering jobs
xAI

Software Engineer

xAIPalo Alto, CA

Build and operate realtime and batch data pipelines processing billions of events daily at xAI. Design distributed data platforms, own data correctness, create shared datasets for product and business teams, and partner on data acquisition using tools like Spark, Kafka, Flink, and SQL.

125k – 400k
On-site3+ YOEData Engineering
Axle

Bioinformatics Engineer

AxleRockville, MD

Develop and optimize Nextflow-based bioinformatics pipelines for high-throughput sequencing analysis on Google Cloud Platform. Requires 3+ years of production pipeline experience, Nextflow proficiency, and strong genomics analysis skills.

125k – 150k
On-site3+ YOEData Engineering
Applied Intuition

Data & ML Pipeline Software Engineer

Applied IntuitionSunnyvale, CA

Builds large-scale data processing pipelines and ML infrastructure to automate data curation, model training, and iteration for autonomous vehicles using real-world and simulation data. Requires 3-5 years experience in data/ML infra, Python, and frameworks like Spark/Airflow/Kafka.

125k – 222k
On-site3+ YOEData Engineering
Permitflow

Analytics Engineer

PermitflowNew York, NY

Builds and maintains scalable data pipelines, models, and warehouses to enable business intelligence and decision-making. Collaborates with teams on data integration, governance, and self-serve analytics using SQL, dbt, Python, and BI tools. Requires 3+ years experience.

125k – 215k
Hybrid3+ YOEData Engineering
Brex

Data Engineer

BrexSan Francisco, CA

Build and maintain scalable data models, pipelines, and Core Data tables to transform raw data into actionable insights. Collaborate with data scientists and business teams using SQL, DBT, Snowflake, Airflow, and Python.

121k – 151k
Hybrid3+ YOEData Engineering