Staff Software Engineer (L4) Data Platform
Architects scalable data systems and platforms using distributed technologies like Spark, Kafka, and AWS. Mentors engineers and drives innovation on large-scale data projects, requiring 8+ years experience and expertise in data infrastructure.
About the job
Responsibilities
- Serve as a subject matter expert in distributed systems, data technologies, with strong software engineering skills.
- Architect and implement scalable and efficient data systems, storage solutions, and processing frameworks using state-of-the-art technologies.
- Drive technical innovation and research to stay at the forefront of emerging data technologies and best practices.
- Mentor and coach a team of talented engineers, fostering a culture of technical excellence, collaboration, and continuous learning.
- Collaborate closely with cross-functional teams to understand business requirements and translate them into scalable and efficient technical solutions.
- Ensure data quality, integrity, and security throughout the data lifecycle, adhering to industry best practices and compliance standards.
Qualifications
Required
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in software development, or a related field.
- Proven track record of architecting and delivering complex data projects at scale, with a deep understanding of data infrastructure and distributed systems.
- Expertise in big data technologies such as Hadoop, Spark, Kafka, and other distributed computing systems.
- Experience designing, building, and operating large-scale systems using AWS technologies.
- Proficiency in programming languages such as Python, Java, or Scala, with strong problem-solving skills and attention to detail.
- Experience designing or working with Data Lakehouse architectures, including hands-on experience with Hudi, Iceberg, or Delta data formats.
- Excellent communication and collaboration skills, with the ability to influence technical decisions and drive alignment across teams.
- Strong leadership skills, with a track record of mentoring and developing junior engineers.
- Demonstrated ability to thrive in a fast-paced, dynamic environment and deliver results under tight timelines.
Desired
- Contributions to OSS projects is a bonus.
- Familiarity with data modeling, data warehousing, and ETL processes is a plus.
Compensation
$171,120.00 to $213,900.00
Skills
Python, Java, Scala, Hadoop, Spark, Kafka, AWS, Hudi, Iceberg, Delta Lake
Similar jobs
Data Engineering jobs
United States
Leads the design, operation, and technical direction of Pinterest’s data workflow and context control planes, driving reliability, scalability, AI-native capabilities, and open-source contributions. Requires 10+ years of distributed-systems experience, infrastructure expertise, and proficiency in Python or Java.
United States
Provides technical leadership for Pinterest’s data warehouse foundation and agentic analytics platforms at massive scale. The role designs warehouse architecture, leads cross-functional initiatives, mentors engineers, and requires extensive data platform experience plus hands-on AI tooling expertise.
SmithRx
United States
Leads enterprise data engineering strategy, architecture, delivery, governance, and technical leadership across the organization. Requires extensive data engineering experience, advanced data modeling and warehouse expertise, and strong PySpark, SQL, and Python skills.
IntusCare
United States
Staff-level engineer responsible for the technical direction, reliability, and evolution of a cloud ELT platform supporting healthcare data products. The role requires 7+ years of software or data engineering experience, deep SQL/Python and modern data-platform expertise, and strong architectural and mentoring leadership.
Rula
United States
Leads organization-wide Snowflake migration, Medallion architecture, warehouse optimization, and CI/CD quality controls while partnering with executives on data strategy. The role requires 6+ years in analytics or data engineering, expert SQL, production dbt experience, and strong architectural judgment.