Skip to content
PointClickCarePointClickCareUnited States

Senior Software Engineer- Big Data & Java

Develops and maintains big data applications using Java and distributed systems like Apache Hudi, Spark, and Trino. Collaborates on requirements, ensures scalable code with TDD, and works with storage systems like S3 and ADLS.

158k – 176k
RemoteData Engineering

About the role

What your day-to-day will look like:

  • Identify, prioritize and execute tasks in the software development life cycle.
  • Work with business to iterate over software requirements.
  • Develop tools and applications by producing clean, efficient code.
  • Automate tasks through appropriate tools and scripting.
  • Analyze and debug systems.
  • Perform validation and verification testing in a test-driven manner
  • Review the work of others, and invite others to review your work.
  • Collaborate with internal teams and vendors to fix and improve products.
  • Ensure software is up-to-date with latest technologies.
  • Work with distributed computing systems like Apache Hudi and Trino for big data processing.

What qualifications we’re looking for:

  • Experience with distributed computing tools like Apache Hudi, Spark, Kafka, Flink, Beam, Trino, DataBricks and other big data technologies.
  • Experience with distributed storage systems like ADLS, HDFS, S3, DLT etc.
  • Familiarity with Hadoop, Spark, Databricks or other distributed computing systems.
  • Understanding of data partitioning and sharding techniques.
  • Knowledge of distributed computing principles and how they apply to large-scale data processing.
  • Experience in writing clean code that performs well at scale using languages such as Python, Java etc.
  • Knowledge of relational databases (e.g. Microsoft SQL Server, MySQL).
  • Solid experience writing RESTful API endpoints.
  • Absolutely love TDD and have working knowledge of it.
  • Proficient in GIT.
  • Experience using system and performance monitoring tools (e.g. New Relic, DataDog).
  • Excellent organization, critical-thinking and personal leadership skills
  • Self-starter with the ability to deliver with minimal supervision.
  • Bein okay with the uncomfortable feeling that comes from learning new things.
  • Team player.
  • Analytical mind with problem-solving aptitude.
  • Proven experience as a great Engineer.
  • BSc/BA in Computer Science or a related degree.

Bonus points for:

  • Experience with distributed computing
  • Experience writing code/scripts in Python
  • Experience with Spring Boot.
  • Nice to have React, Selenium automation and cloud experience.
  • Experience with Docker, Kubernetes and Istio.
  • Experience with Ansible.
  • Experience with Jenkins CI/CD pipeline.
  • Linux and IP networking knowledge.
  • Experience with AWS/Azure cloud services or equivalent.
  • Experience with SAML, OAuth and OpenID Connect.
  • Experience working on a SaaS product.
  • Experience with Service Oriented Architecture.
  • Knowledge of scripting languages such as Python, Bash or Groovy.
  • On-call experience with production grade systems.
  • Has mentored others in a professional setting.
  • Generative AI Code Assistants - Use of Generative AI Code Assistants (e.g. Github Copilot) and knowledge of latest Generative AI Model capabilities would be an asset.

Skills

Apache HudiSparkKafkaTrinoDatabricksJavaPythonHadoopKubernetesDocker

Similar roles

Data Engineering jobs
Launchdarkly

Senior Backend Engineer, Data Platform

LaunchdarklyAustin, TX +8

Senior Backend Engineer building and operating distributed data infrastructure for streaming, batch processing, analytical stores, and warehouse exports at scale. Requires 6+ years backend experience with data pipelines, distributed systems, and production ownership (on-call).

158k – 257k
Remote6+ YOEData Engineering
Databricks

Senior Software Engineer - Distributed Data Systems

DatabricksBellevue, WA

Build distributed data storage and processing systems for big data workloads including Apache Spark, Delta Lake, and performance optimization. Requires 5+ years in Java/Scala/C++, strong algorithms knowledge, and distributed systems experience.

158k – 214k
On-site5+ YOEData Engineering
Checkr

Senior Data Engineer

CheckrDenver, CO +1

Senior Data Engineer building and scaling Checkr's centralized People Data platform and large-scale batch/streaming pipelines that power identity and people records for all products. Requires 5+ years experience with Python, PySpark, SQL, Spark, Kafka and AWS data services; leads execution, mentors, and partners with cross-functional teams.

157k – 218k
Hybrid5+ YOEData Engineering
Metropolis

Senior Data Engineer

MetropolisNew York, NY +4

Designs and owns data architecture, builds/optimizes pipelines and models using Python, SQL, Snowflake, dbt, and AWS. Manages SLAs, data governance, and mentors team; requires 5+ years experience and bachelor's in CS or related.

160k – 220k
On-site5+ YOEData Engineering
Lithic

Senior Software Engineer, Data Platform

LithicUnited States

Builds backend services and REST APIs serving data from Snowflake and other sources to internal teams, while supporting data pipelines with Airflow, Airbyte, and dbt. Requires strong Python, SQL, API design experience; preferred fintech background.

160k – 200k
RemoteData Engineering