Senior Software Engineer, Data Platform

Responsibilities

• Build, expand, and optimize data infrastructure to create the most accurate dataset of identities and their relationships
• Develop and operate secure, scalable, and reliable data ingestion and ETL/ELT pipelines that meet product requirements
• Design and maintain a data observability framework to ensure data meets strict quality and freshness standards
• Optimize data storage layer and build/maintain interfaces to enable scalable and fast data access to data stores
• Collaborate with product teams supporting their data platform needs for smooth delivery of existing and new products
• Participate in call rotation for production issues, along with the rest of engineering
• Mentor junior engineers and contribute to evolving engineering best practices
• Drive innovation by participating in hackathons and doing proof of concepts
• Develop functional subject matter expertise within various areas of identity fraud domain

Requirements

• 5+ years of experience in software engineering, data engineering or related field
• Proficient in Python or Golang and related technologies and frameworks
• Expertise in building and maintaining ETL/ELT pipelines at scale leveraging distributed data processing technologies like Spark, Hadoop, Kafka or similar
• Hands-on experience with public cloud platforms such as AWS, Microsoft Azure or GCP
• Deep understanding of different database technologies including RDBMS (e.g. Postgres), NoSQL (OpenSearch, vector DB), columnar data stores etc. and experience with writing efficient queries and optimization techniques
• Experience building enterprise grade, scalable, containerized data services and frameworks on Kubernetes or similar platforms
• Working knowledge of Infrastructure-as-Code and DevOps practices
• Excellent analytical and problem solving skills, interpersonal skills and a sense of humor
• Self organized and ability to work independently and with ambiguity
• Experience working in a scrum / Agile development environment

Nice-to-haves

• Experience working with Spark/EMR
• Built streaming applications
• Experience with AWS technologies such as EKS, SQS/SNS, EMR, Redshift, S3 etc.
• Prior experience working in a fintech startup

Compensation

• $170,000/year - $240,000/year + equity + benefits
• Employer paid group health insurance for you and your dependents
• 401(k) plan with employer match
• Flexible paid time off
• Regular company-wide in-person events
• Home office stipend, and more!