Senior Software Engineer I — Agentic Analytics
Build production LLM-powered systems for Instacart’s AI-for-Data platform, including retrieval, agentic workflows, evaluations, and internal data tools. The role requires strong Python backend engineering, SQL and data infrastructure experience, applied LLM expertise, and at least five years of professional experience.
About the job
Responsibilities
- Build LLM-powered systems end-to-end, including retrieval and grounding over internal metadata and code, agentic workflows, evaluation and quality systems, and product surfaces for internal users.
- Drive initiatives for the AI-for-Data charter and contribute to the roadmap.
- Collaborate with engineers to establish rigor around evaluations, observability, safety, and cost for applied AI systems.
- Work with Data Science, ML, Product Engineering, and Data Infrastructure teams to identify high-leverage AI applications and deliver reliable, production-grade systems.
Requirements
- Self-motivation and comfort operating in ambiguity.
- Strong ownership and experience shipping production systems rather than only prototypes.
- Strong backend engineering skills in Python, including production service development.
- Hands-on experience with applied LLM systems, such as RAG, agentic workflows, prompt engineering, or evaluations.
- Experience working with LLM-powered systems in production or near-production environments.
- Working knowledge of Python, Airflow, Snowflake, and dbt in production environments.
- Strong SQL knowledge.
- Experience working with large codebases on cross-functional teams.
- Ability to balance urgency with high-quality, pragmatic solutions.
- At least 5 years of professional experience in a similar field or environment.
Nice-to-haves
- Experience with retrieval systems, vector stores, or grounding LLMs over structured or unstructured enterprise data.
- Familiarity with evaluation frameworks and quality systems for LLM-powered products.
- Experience building developer tools or internal tools for technical users.
- Bachelor's degree in Computer Science, Computer Engineering, or Electrical Engineering, or equivalent work experience.
Compensation and Benefits
- Annual base salary: CA$168,000–CA$177,500 CAD.
- Eligible for a new-hire equity grant and annual refresh grants.
- Benefits are provided according to the employee's location.
- This role is remote and currently open to candidates permanently located in Ontario, Alberta, British Columbia, or Nova Scotia.
Skills
Python, LLMs, Retrieval-Augmented Generation, Agentic Workflows, Prompt Engineering, SQL, Apache Airflow, Snowflake, dbt, Vector Stores, Evaluation Frameworks, Observability
Similar jobs
ML Engineering jobs
Instacart
United StatesBuild and deploy machine learning systems that apply economic theory, econometrics, and causal inference to marketplace problems. The role requires advanced training in economics, strong Python and data skills, and production ML experience for senior-level hires.
Dialpad
Vancouver, Canada
Senior AI engineer owning production systems for real-time speech models and AI voice agents. The role requires 5+ years of production software experience, Python, model serving and inference optimization, cloud and distributed systems expertise, and strong reliability and operations skills.
Censys
United StatesBuild and deploy production machine-learning models and data systems that classify and enrich Internet telemetry for internal platforms and customer-facing products. The role requires 5+ years of applied ML, data science, or software engineering experience, plus strong Python or Go skills.
Apartment List
United StatesBuild marketplace search and ranking features while supporting MLOps infrastructure, model deployment, feature stores, and real-time data pipelines. The role requires 5+ years of software engineering or MLOps experience, backend or full-stack expertise, and familiarity with cloud and machine learning tooling.
Instacart
United StatesDevelop and deploy production machine learning models for real-time inventory and shelf-stocking intelligence at scale. The role requires 5+ years of production ML experience, strong Python and ML framework skills, cloud and data pipeline expertise, and a bachelor's degree or equivalent experience.