Senior Software Engineer, Applied AI
Build and operate backend infrastructure for an AI agent platform, including orchestration, integrations, knowledge systems, trust and safety, and evaluation tooling. The role requires 5+ years of backend experience, hands-on LLM or agent experience, strong API design, and ownership in an ambiguous product environment.
About the job
Responsibilities
- Design, build, and own core components of the agent platform, including the orchestration layer and tool integrations with internal systems.
- Build and evolve the capabilities layer, including APIs, data access patterns, and service integrations for agents to execute operational workflows.
- Architect knowledge and memory infrastructure so agents can retrieve data and act across systems.
- Design and implement trust and safety frameworks, including audit trails, human-in-the-loop controls, and guardrails for safe, auditable AI-driven operations.
- Contribute to agent evaluation and testing infrastructure, defining measures for accuracy, reliability, and behavioral regression.
- Partner with Operations to understand workflows, identify automation opportunities, and translate process knowledge into agent capabilities.
- Mentor engineers as the team grows.
Requirements
- 5+ years of backend engineering experience building and operating production systems.
- Hands-on experience with large language models and AI agents, including orchestration, retrieval-augmented generation, tool or function calling, or similar technologies.
- Strong API design and systems integration skills.
- Product-minded approach, including contributing to product decisions and questioning requirements.
- Proven ownership of complex projects in ambiguous, early-stage environments.
- Strong backend engineering fundamentals and experience designing, building, and operating production systems.
- Curiosity and motivation to build practical, real-world products using AI and large language models.
Technologies
- Golang
- Ruby on Rails
- JavaScript
- Java
- C#
- Python
- Vue.js
- MySQL
- Kafka
- AWS
- Git
- Memcache
- Redis
- Elasticsearch
- Docker
- Terraform
- Kubernetes
- CircleCI
- Datadog
Compensation
- Base wage range: $188,000.00–$242,000.00 CAD per year for the Toronto office.
Skills
Go, Ruby on Rails, JavaScript, Java, C#, Python, Vue, MySQL, Kafka, AWS, Redis, Elasticsearch, Docker, Terraform, Kubernetes
Similar jobs
Backend Engineering jobs
Vanta
Remote
Build and operate the backend runtime platform that schedules, executes, and persists security and compliance tests at scale. The role requires strong production systems experience, ownership of complex projects, debugging expertise, and effective technical collaboration and mentorship.
Instacart
Canada
Builds and owns scalable backend platforms for audience targeting and high-volume CRM messaging, including real-time and batch data pipelines and distributed services. Requires 5+ years of backend experience with Ruby and Go, distributed systems expertise, and strong cross-functional collaboration.
MongoDB
Toronto, Canada
Build and lead backend systems for MongoDB’s integrated search platform, written in Java. The role requires 5+ years of backend software experience, distributed systems and cloud expertise, and strong ownership and collaboration skills.
1Password
United StatesThe Senior Developer will independently design, deliver, and improve enterprise-scale SaaS management features while guiding technical decisions and mentoring teammates. The role requires 5+ years of software development experience with strong .NET, C#, and MongoDB expertise, and is remote within the US and Canada.
Censys
United StatesBuild and maintain highly available, scalable distributed services, data pipelines, and platform capabilities that power Internet intelligence and security products. The role requires 5+ years of distributed-systems software engineering experience and proficiency with Go, cloud platforms, messaging systems, and databases.