Senior Software Engineer - Data
Designs and builds scalable distributed data systems and pipelines powering blockchain analytics products. The role is hands-on, requiring production experience with Scala, Java, or Python, big-data technologies, cloud infrastructure, and data orchestration, plus technical leadership and mentoring.
About the job
Responsibilities
- Write, ship, and maintain production code as a hands-on engineer.
- Architect, design, and implement large-scale distributed data systems and pipelines.
- Contribute to technical decisions across batch and streaming data solutions.
- Collaborate with engineers, product managers, data scientists, and intelligence analysts to build customer-focused products.
- Explore and integrate data orchestration and cloud-native technologies to improve performance and scalability.
- Own data systems from design through deployment, ongoing improvement, and support.
- Conduct peer reviews, share best practices, and improve code quality.
- Contribute to initiatives improving reliability, observability, and cost efficiency.
- Help shape the technical roadmap for data engineering.
- Mentor and coach less-experienced engineers.
- Use AI and agentic systems effectively in engineering workflows.
Requirements
- Hands-on production engineering experience with Scala, Java, or Python.
- Ability to design, build, and maintain distributed data systems in cloud-based environments.
- Hands-on experience with big data frameworks such as Spark or Databricks.
- Knowledge of cloud infrastructure, including AWS, GCP, or Azure.
- Ability to balance scalability, performance, and maintainability.
- Experience with data modeling and workflow orchestration.
- Interest in AI-driven engineering tooling.
Nice-to-haves
- Functional Scala experience.
- Infrastructure as Code experience with Terraform or CloudFormation.
- Experience with stream-processing frameworks and event-driven architecture.
- Experience in containerized environments using Docker or Kubernetes.
- Interest in cryptocurrency and blockchain technologies.
Compensation and Benefits
- Hybrid working, with the option to work from almost anywhere for up to 90 days per year.
- £500 remote-working budget for home-office setup.
- $1,000 learning and development budget.
- 25 days of annual leave plus bank holidays.
- Additional day off for your birthday.
- Enhanced parental leave, including 16 weeks of fully paid leave for eligible employees.
- Private health insurance through Vitality.
- Spill mental health support.
- Life assurance covering four times salary for beneficiaries.
- Cycle to Work Scheme.
Skills
Scala, Java, Python, Spark, Databricks, AWS, GCP, Microsoft Azure, Apache Airflow, Kubernetes, Terraform, Docker, Functional Programming, Stream Processing, Data Modeling
Similar jobs
Data Engineering jobs
Alpaca
Remote
Build and operate scalable lakehouse infrastructure, streaming and CDC pipelines, query systems, and self-serve BI capabilities. Requires 5+ years of data engineering experience, strong Kubernetes and infrastructure-as-code expertise, and hands-on experience with distributed data platforms.
Thyme Care
Remote
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Vanta
Remote
Senior Data Engineer responsible for designing and deploying scalable data infrastructure, orchestration models, and analytics tooling to enable data-driven decisions, ML products, and enterprise reporting at Vanta. Requires 4+ years data experience, software engineering mindset, modern data stack proficiency, and passion for secure, compliant data systems.
Vanta
Remote
Senior Analytics Engineer responsible for designing complex data models, building scalable SQL pipelines, enabling AI tooling, and improving data infrastructure to support self-serve analytics, dashboards, and data science at Vanta. Requires 4+ years data experience, software engineering mindset, and expertise with modern analytics tools like dbt.
Spotify
London, United Kingdom
Build and evolve large-scale data collection infrastructure and architectures supporting user behavior data, personalization, and recommendation systems. The role requires strong Java and SQL experience, JVM-based data processing expertise, and familiarity with cloud, Kubernetes, and modern engineering practices.