Senior Software Engineer, Data Platform
Senior Software Engineer on the Data Platform team owns data infrastructure, builds scalable ETL/ELT pipelines, optimizes storage, and collaborates with product and data science teams. Requires 5+ years experience in data engineering with Python/Golang, Spark, AWS, and Kubernetes.
About the job
Responsibilities
- Build, expand, and optimize data infrastructure to create the most accurate dataset of identities and their relationships
- Develop and operate secure, scalable, and reliable data ingestion and ETL/ELT pipelines that meet product requirements
- Design and maintain a data observability framework to ensure data meets strict quality and freshness standards
- Optimize data storage layer and build/maintain interfaces to enable scalable and fast data access to data stores
- Collaborate with product teams supporting their data platform needs for smooth delivery of existing and new products
- Participate in call rotation for production issues, along with the rest of engineering
- Mentor junior engineers and contribute to evolving engineering best practices
- Drive innovation by participating in hackathons and doing proof of concepts
- Develop functional subject matter expertise within various areas of identity fraud domain
Requirements
- 5+ years of experience in software engineering, data engineering or related field
- Proficient in Python or Golang and related technologies and frameworks
- Expertise in building and maintaining ETL/ELT pipelines at scale leveraging distributed data processing technologies like Spark, Hadoop, Kafka or similar
- Hands-on experience with public cloud platforms such as AWS, Microsoft Azure or GCP
- Deep understanding of different database technologies including RDBMS (e.g. Postgres), NoSQL (OpenSearch, vector DB), columnar data stores etc. and experience with writing efficient queries and optimization techniques
- Experience building enterprise grade, scalable, containerized data services and frameworks on Kubernetes or similar platforms
- Working knowledge of Infrastructure-as-Code and DevOps practices
- Excellent analytical and problem solving skills, interpersonal skills and a sense of humor
- Self organized and ability to work independently and with ambiguity
- Experience working in a scrum / Agile development environment
Nice-to-haves
- Experience working with Spark/EMR
- Built streaming applications
- Experience with AWS technologies such as EKS, SQS/SNS, EMR, Redshift, S3 etc.
- Prior experience working in a fintech startup
Compensation
- $170,000/year - $240,000/year + equity + benefits
- Employer paid group health insurance for you and your dependents
- 401(k) plan with employer match
- Flexible paid time off
- Regular company-wide in-person events
- Home office stipend, and more!
Skills
Python, Go, Postgres, Opensearch, Redshift, Emr, Spark, Docker, AWS, Kubernetes, ETL, ELT, Kafka, Hadoop
Similar jobs
Data Engineering jobs
Vercel
San Francisco, CAOwns the Finance data infrastructure supporting billing, usage-based revenue, forecasting, reporting, and close. The role requires production data engineering experience, strong SQL and Python, dbt and orchestration expertise, Finance-domain fluency, and the ability to mentor engineers and partner with business stakeholders.
Vercel
San Francisco, CAOwns end-to-end GTM data pipelines, transformations, and models that power reliable pipeline, revenue, attribution, and funnel reporting. The role requires senior-level data engineering experience, strong SQL and Python, dbt and orchestration expertise, GTM metric fluency, and stakeholder partnership skills.
Bevi
Boston, MA
Own and evolve Bevi’s end-to-end data platform, from ingestion and IoT modeling through governed self-service analytics and AI access. The senior individual contributor will architect scalable streaming and batch systems, establish governance and observability, and provide technical leadership across the Data & Data Science organization.
Clay
New York, NYBuild customer-facing data products and shared platform systems that transform conflicting, constantly changing sources into reliable, searchable information. The role requires 8+ years of hands-on engineering experience, strong Python and SQL skills, and ownership of product quality, reliability, and delivery.
Atticus
Los Angeles, CA
Lead the development and maintenance of scalable data pipelines, warehouse, and transformation layer using modern data stack. Collaborate with data scientists and analysts to ensure clean, reliable data for insights in a high-growth startup.