Senior Data Engineer
Senior Data Engineer building ETL pipelines, data processing systems, and Lakehouse architecture on AWS to map decision-maker networks. Requires 6+ years experience, expert SQL, Spark, and data warehousing tools.
Senior Data Engineer
Designs and owns data architecture, builds/optimates scalable ETL pipelines and data models using Python, SQL, Snowflake, dbt on AWS. Requires 5+ years data engineering experience, Bachelor's in CS or related; 4 days/week onsite in Chicago.
160k – 220kChicago, ILData EngineeringOnsite5+ YOE
About the role
Responsibilities
- Collaborate with cross-functional teams to develop end-to-end data pipelines and foundational data sets
- Design and own data architecture for large-scale projects while managing operational trade-offs
- Build and optimize sophisticated data pipelines, models, and visualizations across multiple domains
- Define and manage Service Level Agreements (SLAs) for all owned data sets
- Implement data security models, ensure privacy compliance, and evolve data governance processes
- Solve complex integration challenges using optimal ETL/ELT patterns for structured and unstructured data
- Maintain production processes by optimizing complex code using advanced algorithmic concepts
- Streamline data artifact development by optimizing pipelines, dashboards, and frameworks
- Mentor team members through actionable feedback to foster collective skill growth
- Maintain flexibility with availability during evening hours
Requirements
Education:
- Bachelor's degree in Computer Science, Computer Engineering, or a relevant technical field (Master's preferred)
Experience:
- 5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools, working with large data sets in the cloud
- 5+ years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems
Skills:
- Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in Snowflake and dbt
- Hands-on experience with RDBMS such as MySQL, MS SQL Server (optional), and Postgres
- Familiarity with integration tools like Airflow and Automic, along with a working knowledge of CI/CD pipelines
- Ability to deliver high standards of code quality, system reliability, and performance
- Deep understanding of the modern IaC ecosystem to drive automated infrastructure deployments
- Experience with cloud computing services, preferably AWS, including hands-on experience with services like Glue, Airflow (MWAA), DMS, EKS, and SNS
Nice-to-Haves
- Experience with Spark and PySpark
- Master's degree in Computer Science, Computer Engineering, or a relevant technical field
Compensation
- Base salary: $160,000 - $220,000 USD annually
- Total compensation may include healthcare benefits, 401(k), disability coverage, life insurance, stock options, bonus plans
Skills
PythonSQLSnowflakedbtAirflowAWSETLELTPostgresMySQLSparkPysparkGlueKubernetesIac
Similar roles
Data Engineering jobsSenior Data Pipeline & AI Engineer
Senior engineer building and scaling high-throughput data pipelines that deliver Fullstory session data to customer warehouses and power LLM-based AI agents. Owns architecture, production reliability, and AI evaluation frameworks.
Senior Software Engineer, Data Pipeline
Build and evolve high-scale data ingestion pipelines processing hundreds of thousands of events per second using Go, Kubernetes, and GCP. Senior engineer role focused on distributed systems reliability and performance.
Senior Data Infrastructure Engineer
Own and evolve Voltus' data pipelines, orchestration, modeling, and governance to deliver reliable analytics and AI-ready infrastructure.