Skip to content
6sense6senseSan Francisco, CA

Sr. Software Engineer

Design and build scalable big data systems and ETL pipelines using Spark, Kafka, Hive and related technologies. Requires strong data modeling, SQL, and experience with AI coding assistants.

179k – 263k
Remote5+ YOEData Engineering

About the role

Key Responsibilities

  • Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, multi-dimensional analysis)
  • Design and implement reliable, scalable, robust and extensible big data systems that support core products and business
  • Establish strong engineering design standards and best practices for both technical and non-technical stakeholders

Required Qualifications and Must-Have Skills

  • BS/MS degree in Computer Science or related technical field or equivalent practical experience
  • Experience in the Big Data technologies (Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka etc.)
  • Experience with performing data analysis, data ingestion and data integration
  • Experience with ETL (Extraction, Transformation & Loading) and architecting data systems
  • Experience with schema design, data modeling and SQL queries
  • Hands-on experience using modern AI coding assistants (e.g., Claude Code, Windsurf, or equivalent) to design, implement, and optimize data pipelines and large-scale data processing systems
  • Passionate and self-motivated about technologies in the Big Data area

Nice to Have Skills

  • Experience with Django framework
  • Exposure to AWS

Interpersonal Attributes

  • You can work independently as well as part of a team
  • You take ownership of projects and drive them to conclusion
  • You’re a good communicator and are capable of not just doing the work, but teaching others and explaining the “why” behind complicated technical decisions
  • You can present your architecture and designs to cross teams
  • You aren’t afraid to roll up your sleeves: This role will evolve over time, and we’ll want you to evolve with it!

Skills

HadoopHiveSparkFlinkKafkaPrestoETLSQLData ModelingAWS

Similar roles

Data Engineering jobs
HappyRobot

Data Operations Lead

HappyRobotSan Francisco, CA

Lead data operations for AI audio models at HappyRobot. Translate research needs into data specs, manage end-to-end acquisition/annotation with internal and vendor teams, optimize tooling/workflows, and scale labeling operations to deliver high-quality datasets on time.

180k – 240k
Hybrid5+ YOEData Engineering
Altana

Lead BI Engineer

AltanaBrooklyn, NY +1

Altana is seeking a founding Lead BI Engineer to build and own the company's analytical infrastructure. This role involves designing data warehouses, defining dimensional models, and creating executive dashboards to enable data-driven decision-making across the organization.

180k – 210k
On-site7+ YOEData Engineering
Garner Health

Senior Data Engineer

Garner HealthNew York, NY

Builds, optimizes, and maintains scalable data pipelines using Python, SQL, and AWS tools for healthcare data insights. Requires 4+ years experience, expertise in data modeling, orchestration with Airflow, and familiarity with HIPAA.

180k – 220k
Hybrid4+ YOEData Engineering
Machinify

Senior Software Engineer (Data Platform)

MachinifyUnited States

Build scalable data platform backend systems using Golang/Python to support AI-driven healthcare solutions. Requires 6+ years backend experience, expertise in Kubernetes, cloud platforms, ETL, and data orchestration tools.

180k – 220k
Remote6+ YOEData Engineering
Machinify

Senior Data Engineer 

MachinifyUnited States

Build and scale production data pipelines using Python, Spark, and Airflow to transform raw healthcare data into trusted datasets powering ML models, dashboards, and customer onboarding. Requires 6+ years experience with strong expertise in data engineering tools and cross-team collaboration.

180k – 220k
Remote6+ YOEData Engineering