Head of Operations Engineering
Leads the platform, evaluation, governance, economics, and internal enablement required to operate AI systems reliably in production. Requires hands-on ML/AI, data platform, or AI operations experience, strong LLM fluency, and the judgment to guide investment and build-versus-buy decisions.
About the job
Responsibilities
- Own the AI operations platform, including pipelines, model and prompt versioning, evaluation harnesses, monitoring, and rollback.
- Establish standards for evaluating AI features before and after launch.
- Own inference cost, latency, reliability, and related operational metrics.
- Drive internal AI adoption through tooling, agent workflows, and enablement across Product, Engineering, Marketing, and Support.
- Establish proportionate governance for data handling, vendor risk, and pre-launch evaluation.
- Sequence AI investments against the product roadmap and financial model.
- Make build-versus-buy decisions and identify areas the company should not build.
- Mentor engineers and analysts working on AI systems and raise operational standards.
Requirements
- 5–7 years of experience in ML/AI engineering, data platforms, or AI operations, including hands-on ownership of production systems.
- Experience operating AI or ML systems in production, including pipelines, model and prompt versioning, evaluation, monitoring, and incident response.
- Fluency with modern LLM tooling and the practical constraints of cost, latency, context limits, and nondeterministic outputs.
- Track record of driving internal AI adoption through enablement, tooling, and workflow changes.
- Strong build-versus-buy judgment and comfort making pragmatic decisions with incomplete information.
- Ability to establish practical guardrails for data handling, vendor risk, and pre-launch evaluation.
- Excellent communication skills, including explaining AI trade-offs to engineers and executives.
Compensation and Benefits
- Competitive compensation package including cash, equity, and benefits.
- Annual wellbeing allowance.
- Employer retirement contribution.
- Generous vacation, holiday, parental, and volunteer leave.
- Employee stock option program.
Skills
Ml Engineering, Ai Operations, Data Platforms, Llm Tooling, Model Versioning, Prompt Versioning, Evaluation Harnesses, Monitoring, Incident Response, Data Governance, Vendor Risk, Ai Pipelines
Similar jobs
ML Engineering jobs
Linktree
Melbourne, AustraliaLeads the production AI platform and internal AI adoption strategy, overseeing pipelines, evaluations, monitoring, reliability, cost controls, governance, and enablement. Requires substantial hands-on experience operating ML/AI systems and strong judgment across technical and executive stakeholders.
Shield AI
Melbourne, Australia
Develop and deploy deep-learning perception solutions for autonomous and non-autonomous platforms, taking computer vision research into real-time edge production. Requires deep learning and computer vision experience, modern model architectures, and relevant tertiary qualifications.
Shield AI
Melbourne, Australia
Develop and deploy advanced deep-learning computer vision and perception solutions for edge devices, while contributing to research, scalable MLOps tooling, and production optimization. Requires 3–5 years of industry experience, relevant tertiary qualifications, and expertise in modern vision architectures.
Payabli
Remote
Sets the technical direction for production machine learning across a payments platform, building and scaling models for risk, authorization, disputes, and forecasting. Requires 8+ years of ML engineering experience, including production model ownership and strong technical leadership.
Protege
Remote
Build the technical foundation for a new business vertical, creating reusable infrastructure and leading early customer engagements from scoping through delivery. The role requires 3+ years of engineering experience, strong Python and SQL skills, backend/data expertise, and comfort operating in ambiguity.