Senior Software Engineer, Data Pipelines
Senior software engineer building and operating scalable data-pipeline infrastructure, automation, and reliability tooling. The role requires 5+ years of software, systems, and automation experience, plus expertise in cloud infrastructure, data streaming, and operational tooling.
About the job
Responsibilities
- Maintain and analyze operating-system, control-plane, and application metrics for fault detection and performance improvements.
- Design, develop, and deploy tooling and systems that improve platform reliability, scalability, and efficiency.
- Balance feature development speed and reliability against service-level objectives.
- Operate and improve infrastructure using industry best practices and tools.
- Participate in design and production-readiness reviews, platform management, and capacity-planning activities with cross-functional teams.
- Document infrastructure operations processes and insights, identify repeatable actions, and automate repetitive tasks.
- Participate in on-call rotations, respond to incidents, and help teams mitigate customer-impacting events.
Requirements
- 5+ years of experience on teams responsible for software development, automation, and systems engineering.
- Ability to write production-ready code in one or more high-level languages, such as Go or Python.
- Experience with data streaming, storage, and management, particularly DynamoDB, Kinesis, Kafka, SQS, S3, GraphQL, Flink, or Hive.
- Experience operating large-scale infrastructure in public cloud environments such as AWS.
- Experience with infrastructure tooling such as Terraform, CloudFormation, Docker, Kubernetes, Ansible, Chef, or Puppet, preferably in an AWS context.
- Ability to identify emerging problems, performance bottlenecks, and improvement opportunities, then develop and execute mitigation plans.
Compensation and Benefits
- Base salary: CAD $136,000–$170,000 per year, excluding potential equity, bonus, and benefits.
- Extended health and dental coverage, life insurance, and disability benefits.
- Mental health, family-building, childcare, and pet benefits.
- Lyft-funded Health Care Savings Account.
- RRSP plan with company match.
- Flexible paid time off for salaried team members; hourly team members receive 15 days of paid time off, with an additional day per year of service.
- Up to 18 weeks of paid parental leave through a top-up plan.
- Subsidized commuter benefits and Lyft ride credits.
Skills
Go, Python, DynamoDB, Kinesis, Kafka, Amazon Sqs, Amazon S3, GraphQL, Apache Flink, Apache Hive, AWS, Terraform, CloudFormation, Docker, Kubernetes
Similar jobs
Data Engineering jobs
Lyft
Toronto, Canada
Leads architecture for offline experimentation and route simulation while building reliable, scalable data pipelines and backend services. The role requires 5+ years of backend or data engineering experience, distributed-systems expertise, strong SQL and Spark skills, and proficiency with modern cloud infrastructure.
Clickhouse
United StatesSenior software engineer building high-throughput database and data-platform integrations for ClickHouse, with responsibility for reliability, production debugging, and customer-driven product innovation. Requires 5+ years of experience, systems programming skills, and cloud-native Kubernetes expertise.
Wrapbook
United StatesBuild and own Wrapbook’s analytics layer, including production pipelines, governed data models, canonical datasets, self-serve analytics, and monitoring. The role requires strong SQL and Python, modern warehouse experience, and 4+ years in data or analytics engineering.
Twilio
United StatesBuilds agentic AI, automated data workflows, and BI solutions for complex telecommunications datasets. The role requires 5+ years of technical data and automation experience, strong SQL and Python skills, and expertise in data governance and LLM-based tools.
Twilio
Ontario, CanadaThe Senior Data and AI Specialist will build agentic AI solutions, automated Python workflows, and analytics products across telecommunications data. The role requires at least five years of experience with SQL, data automation, BI tools, LLM agents, and data governance.