Sr. Software Engineer
Design and build scalable big data systems and ETL pipelines using Spark, Kafka, Hive and related technologies. Requires strong data modeling, SQL, and experience with AI coding assistants.
About the job
Key Responsibilities
- Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, multi-dimensional analysis)
- Design and implement reliable, scalable, robust and extensible big data systems that support core products and business
- Establish strong engineering design standards and best practices for both technical and non-technical stakeholders
Required Qualifications and Must-Have Skills
- BS/MS degree in Computer Science or related technical field or equivalent practical experience
- Experience in the Big Data technologies (Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka etc.)
- Experience with performing data analysis, data ingestion and data integration
- Experience with ETL (Extraction, Transformation & Loading) and architecting data systems
- Experience with schema design, data modeling and SQL queries
- Hands-on experience using modern AI coding assistants (e.g., Claude Code, Windsurf, or equivalent) to design, implement, and optimize data pipelines and large-scale data processing systems
- Passionate and self-motivated about technologies in the Big Data area
Nice to Have Skills
- Experience with Django framework
- Exposure to AWS
Interpersonal Attributes
- You can work independently as well as part of a team
- You take ownership of projects and drive them to conclusion
- You’re a good communicator and are capable of not just doing the work, but teaching others and explaining the “why” behind complicated technical decisions
- You can present your architecture and designs to cross teams
- You aren’t afraid to roll up your sleeves: This role will evolve over time, and we’ll want you to evolve with it!
Skills
Hadoop, Hive, Spark, Flink, Kafka, Presto, ETL, SQL, Data Modeling, AWS
Similar jobs
Data Engineering jobs
Creditgenie
Plymouth Meeting, PASenior Data Engineer responsible for designing and operating scalable data pipelines and platform capabilities across Snowflake and AWS. The role requires 5+ years of production data engineering experience, strong SQL and Python skills, and expertise in ETL/ELT, orchestration, quality, and observability.
Machinify
United States
Build and scale production data pipelines that transform raw healthcare and customer data into trusted canonical datasets powering ML models, dashboards, and product decisions. The role requires 6+ years of data engineering experience and strong Python, Spark SQL, and Airflow expertise.
Fetch
United States
Senior software engineer building and evolving Fetch’s data platform, including pipelines, governed data access, delivery infrastructure, and partner integrations. The role requires 8+ years of experience, strong platform or backend expertise, ownership of complex cross-team initiatives, and excellent technical judgment.
Thyme Care
Remote
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Runpod
San Francisco, CA
The Senior Data Engineer will design scalable data pipelines and warehousing systems supporting analytics, business metrics, and machine-learning initiatives. The role requires 4+ years of enterprise data experience, expertise with modern data platforms and ETL, and the ability to mentor engineers and collaborate across functions.