Skip to content
ZoomInfoZoomInfoBethesda, MD

Software Engineer III

Builds and optimizes big data pipelines processing billions of signals for technographic data services. Requires 5+ years experience with Spark, Hadoop, Java/Scala, and distributed systems; collaborates with data scientists on ML integration.

112k – 176k
Hybrid5+ YOEData Engineering

About the role

What You'll Do

  • Build and optimize big data pipelines to extract and process signals from the web, job postings, and other sources
  • Design and implement data architectures and storage solutions to efficiently handle massive data volumes
  • Collaborate closely with data scientists to support and integrate ML models into data workflows
  • Continuously improve data quality, performance, and scalability of our technographic data platform
  • Drive technical strategy and roadmap for the data processing infrastructure

What We're Looking For

  • Extensive experience building and scaling big data pipelines and architectures from scratch
  • Deep expertise in big data frameworks (Hadoop, Spark) and the JVM stack (Java, Scala)
  • Strong software engineering fundamentals and ability to write efficient, high-quality code
  • Experience with entity recognition and NLP techniques a plus
  • Proven track record delivering results and driving projects in a fast-paced environment
  • Excellent collaboration and communication skills to work with data scientists, analysts and product teams
  • Passion for leveraging huge datasets to power valuable insights

Ideal Background

  • 5+ years of experience in software engineering roles
  • Experience working with very large datasets and distributed systems
  • Familiarity building data pipelines at large tech companies or data-driven organizations
  • Bachelor's or advanced degree in Computer Science, Engineering or related technical field

Skills

SparkHadoopJavaScalaBig Data PipelinesDistributed SystemsNLPEntity RecognitionData ArchitecturesMl Models

Similar roles

Data Engineering jobs
Joyful Health

Founding Analytics Engineer

Joyful HealthNew York, NY

Founding Analytics Engineer builds analytics infrastructure from scratch, designs data models and metrics frameworks for healthcare financial data, and creates self-service dashboards. Requires 5+ years experience with SQL, dbt, Python, and cloud data warehouses; NYC-based hybrid role.

120k – 235k
Hybrid5+ YOEData Engineering
Brex

Data Engineer

BrexSan Francisco, CA

Build and maintain scalable data models, pipelines, and Core Data tables to transform raw data into actionable insights. Collaborate with data scientists and business teams using SQL, DBT, Snowflake, Airflow, and Python.

121k – 151k
Hybrid3+ YOEData Engineering
Pinterest

Software Engineer II, Big Data, tvScientific

PinterestSan Francisco, CA

Design and implement scalable data infrastructure using Spark/Scala on AWS. Build data pipelines, knowledge graphs, and APIs to support a high-growth CTV advertising platform.

124k – 255k
RemoteData Engineering
xAI

Software Engineer

xAIPalo Alto, CA

Build and operate realtime and batch data pipelines processing billions of events daily at xAI. Design distributed data platforms, own data correctness, create shared datasets for product and business teams, and partner on data acquisition using tools like Spark, Kafka, Flink, and SQL.

125k – 400k
On-site3+ YOEData Engineering
Axle

Bioinformatics Engineer

AxleRockville, MD

Develop and optimize Nextflow-based bioinformatics pipelines for high-throughput sequencing analysis on Google Cloud Platform. Requires 3+ years of production pipeline experience, Nextflow proficiency, and strong genomics analysis skills.

125k – 150k
On-site3+ YOEData Engineering