Senior Software Engineer
Senior Software Engineer building large-scale distributed data systems and pipelines on Scala, Spark, and Databricks to power blockchain analytics and intelligence products that fight financial crime. Requires hands-on Scala/functional programming experience and expertise designing scalable batch/streaming data platforms in the cloud.
About the job
Responsibilities
- Write, ship, and maintain production code as a hands-on engineer.
- Architect, design, and implement large-scale distributed data systems and pipelines.
- Contribute to technical decision-making across batch and streaming data solutions.
- Collaborate with engineers, product managers, data scientists, and intelligence analysts to build customer-focused products.
- Explore and integrate new technologies (e.g. data orchestration or cloud-native tools) to optimise performance and scalability.
- Take shared ownership of data systems, from design to deployment and ongoing improvement and support.
- Perform thoughtful peer reviews that raise code quality and share best practices across the team.
- Contribute to platform-wide initiatives that improve reliability, observability, and cost efficiency.
- Help shape the technical roadmap for data engineering across Elliptic.
- Leverage and deploy AI and agentic systems to operate more effectively.
- Mentor and upskill engineers, champion best practices, and hold the team to a high standard.
Requirements
- Hands-on production experience with Scala and functional programming.
- Ability to design, build, and maintain distributed data systems in a cloud-based environment.
- Hands-on experience with big data frameworks such as Spark or Databricks.
- Knowledge of cloud infrastructure (AWS, GCP, or Azure).
- Judgement to balance scalability, performance, and maintainability.
- Experience with data modelling and workflow orchestration.
Nice-to-Haves
- Experience in stream processing frameworks and event-driven architecture.
- Hands-on experience with Infrastructure as Code (Terraform, CloudFormation).
- Experience working in containerised environments (Docker, Kubernetes).
- Interest in AI-driven tooling for engineering workflows.
- Interest in crypto and blockchain technologies.
Tech Environment
Scala | Spark | Databricks | AWS | Airflow | Kubernetes | Terraform | Functional Programming
Compensation and Benefits
- Salary: $165,000 - $305,000 (total compensation range)
- Hybrid working: Option to work from almost anywhere for up to 90 days per year.
- Remote Work Budget: $650 to set up home office.
- Learning & Development: $1,000 annual budget.
- Vacation: 25 days annual leave + US Public Holidays + birthday leave.
- Enhanced Parental Leave: 16 weeks fully-paid.
- Healthcare: Comprehensive medical, dental, vision with generous contributions.
- 401k with company match.
- Mental Health support via Spill.
Skills
Scala, Spark, Databricks, AWS, Airflow, Kubernetes, Terraform, Functional Programming, Distributed Systems, Data Modeling, Stream Processing
Similar jobs
Data Engineering jobs
Underdog Fantasy
United States
Build and own the data platform powering regulatory reporting for a federally regulated prediction-markets business. The role combines dbt and SQL engineering, automated validation, root-cause investigations, audit support, and direct collaboration with regulators and compliance.
Granica
Mountain View, CA
Build and optimize foundational lakehouse infrastructure for AI, spanning metadata, transactions, table maintenance, storage layout, and query performance at massive scale. The role requires senior systems engineering experience with modern lakehouse technologies, columnar formats, cloud object storage, and systems-oriented programming languages.
Vercel
San Francisco, CAOwns the Finance data infrastructure supporting billing, usage-based revenue, forecasting, reporting, and close. The role requires production data engineering experience, strong SQL and Python, dbt and orchestration expertise, Finance-domain fluency, and the ability to mentor engineers and partner with business stakeholders.
Vercel
San Francisco, CAOwns end-to-end GTM data pipelines, transformations, and models that power reliable pipeline, revenue, attribution, and funnel reporting. The role requires senior-level data engineering experience, strong SQL and Python, dbt and orchestration expertise, GTM metric fluency, and stakeholder partnership skills.
Bevi
Boston, MA
Own and evolve Bevi’s end-to-end data platform, from ingestion and IoT modeling through governed self-service analytics and AI access. The senior individual contributor will architect scalable streaming and batch systems, establish governance and observability, and provide technical leadership across the Data & Data Science organization.