# Software Engineer II — Agentic AI Foundations

**Company:** [Socure](https://hotfix.jobs/companies/socure)
**Location:** Toronto, Canada
**Role:** ML Engineering
**Salary:** CA$135k – CA$175k/yr
**Experience:** 2+ years
**Skills:** LLMs, Agentic AI, Python, Java, Go, CUDA, vLLM, Ollama, Tensorrt-Llm, Triton Inference Server, Distributed Systems, Kubernetes, Retrieval Systems, Knowledge Graphs, Llm Evaluation
**Posted:** 2026-08-14

> Builds secure, vendor-agnostic agent platform primitives, evaluation tooling, safety controls, retrieval systems, and production workflows. Requires 2+ years of software engineering experience plus strong foundations in LLMs, agentic AI, GPU computing, model serving, and distributed systems.

## Job Description

## Responsibilities
- Build components of a vendor-agnostic agent platform, including orchestration, tool use, memory, and runtime systems.
- Implement evaluation and reliability tooling, including metrics, harnesses, and pipelines, to measure and improve agent performance, robustness, and safety in production.
- Help implement safety and governance controls, including guardrails, policy enforcement, and human-in-the-loop review mechanisms.
- Build data grounding, retrieval, and memory components that keep agents accurate, context-aware, and aligned with domain knowledge and policies.
- Prototype and iterate on agent behaviors, including planning, multi-step execution, and coordination of tools and services.
- Partner with product and engineering teams to implement agent-powered workflows.
- Apply and refine best practices and design patterns for secure, observable, and scalable agent systems.
- Contribute foundational knowledge of LLMs, GPU computing, and model serving to technical discussions and implementation decisions.

## Requirements
- Bachelor's or master's degree in Computer Science, Computer Engineering, Machine Learning/AI, or a related field, or equivalent practical experience.
- 2+ years of professional software engineering experience in distributed systems, backend platforms, infrastructure, or comparable technical environments.
- Strong foundational knowledge of large language models and agentic AI systems, including architectures, prompting, orchestration patterns, tool use, and evaluation approaches.
- Strong understanding of GPU computing and model-serving infrastructure, such as CUDA, vLLM, Ollama, LLMLite, TensorRT-LLM, or Triton Inference Server, including performance and cost trade-offs.
- Solid grounding in distributed systems fundamentals, including concurrency, fault tolerance, observability, and performance.
- Proficiency in at least one modern backend programming language and ecosystem, such as Java, Go, or Python.
- Comfort working with cloud-native infrastructure, APIs, and data services.
- Ability to work productively in ambiguous, early-stage problem spaces with guidance from senior engineers.
- Strong technical performance demonstrated through professional impact, research, challenging projects, open-source contributions, internships, or other relevant work.
- Strong collaboration and communication skills with cross-functional partners.

## Preferred Qualifications
- Experience with multi-agent systems, workflow orchestration, or distributed coordination frameworks.
- Experience building or using agent platforms, orchestration frameworks, tool registries, memory systems, LLM routing, caching, or fine-tuning pipelines.
- Exposure to evaluation frameworks, experimentation platforms, offline or online evaluations, A/B testing, or agent and model benchmarking.
- Experience with AI safety, security, or policy systems, including guardrails, policy engines, content filters, or responsible AI frameworks.
- Experience with retrieval systems, knowledge graphs, or data platforms used to ground LLMs and agents.
- Demonstrated depth in ML systems or LLM infrastructure.

## Compensation
- ATS-listed salary range: 135000–175000 CAD annually.

## Similar jobs

- [Machine Learning Engineer II, Ads - Response Prediction](https://hotfix.jobs/jobs/2de72620-5e5f-4ae8-97a3-4d1932b3062f) - Instacart - Remote - CA$154k – CA$163k/yr
- [Software Engineer - AI Automation](https://hotfix.jobs/jobs/5184d049-8c0b-4184-8b13-c810a07b5886) - Coalition Security - Remote - $115k – $168k/yr
- [AI Software Engineer](https://hotfix.jobs/jobs/c9a0e889-a36e-488f-87d0-e9c27ab63bf0) - Rollstack - Remote
- [AI Engineer - New Verticals](https://hotfix.jobs/jobs/4159c72e-536e-4211-969c-6bcb9ad805fd) - Protege - Remote
- [Agent Systems Engineer](https://hotfix.jobs/jobs/2b04a068-018b-4fe0-915f-4fdf80d4c582) - Adaption Labs - San Francisco, CA

**Apply:** https://hotfix.jobs/jobs/64fb8162-cbe7-4a04-8e15-4fa30b895a82
**Canonical:** https://hotfix.jobs/jobs/64fb8162-cbe7-4a04-8e15-4fa30b895a82