Staff Software Engineer - Reference Data - AI/ML
Leads the design, productionization, and continuous improvement of AI-native products and platform capabilities, including LLM and agentic systems. Requires extensive software engineering experience, production system ownership, and a technical degree or equivalent experience.
About the job
Responsibilities
- Drive end-to-end execution and delivery of AI-native products, from initial prototype through scalable production services.
- Architect, build, and productionize AI platform components, including:
- Large language models and the surrounding ecosystem, such as vector databases and prompt tuning.
- Agentic frameworks.
- Agent capabilities including MCP, cross-platform tool use, web browsing, and computer use.
- Enforce technical discipline and operational excellence across AI products.
- Rapidly iterate on AI products using performance metrics and user feedback.
- Lead evaluation and adoption of new AI technologies and frameworks.
- Partner with product managers and engineering teams to translate strategic goals into technical solutions and abstract AI complexity for rapid iteration.
- Collaborate with engineering leads to define and implement scalable platform architecture.
- Evaluate and drive strategic business and technology decisions for the company and its customers.
- Provide technical leadership, education, best practices, and strategic guidance.
Requirements
- Bachelor's or master's degree in Computer Science, Statistics, Mathematics, or another quantitative or technical field, or equivalent practical experience.
- Extensive software engineering experience.
- Proven track record of owning and shipping complex, production-grade systems.
- Experience shipping and maintaining AI-native products or features, or significant personal AI projects.
- Strong ownership mindset and commitment to completing projects and raising execution standards.
- Bias toward action and passion for rapid shipping and iterative improvement.
Nice-to-haves
- Experience with large language models and agentic systems.
- Hands-on experience with modern AI/LLM technologies such as Databricks, LangChain, or MLflow.
- Advanced understanding of the probabilistic systems underpinning modern LLMs.
- Experience building AI products in highly accuracy-sensitive domains such as finance.
Skills
LLMs, Vector Databases, Prompt Tuning, Agentic Frameworks, Mcp, LangChain, Databricks, MLflow, Ai Platforms, Production Systems
Similar jobs
ML Engineering jobs
Payabli
Remote
Sets the technical direction for production machine learning across a payments platform, building and scaling models for risk, authorization, disputes, and forecasting. Requires 8+ years of ML engineering experience, including production model ownership and strong technical leadership.
Build and deploy embedding, sequence, and language-model representations for Reddit Ads, taking ML projects from requirements and experimentation through production. The role requires 5+ years of end-to-end industry ML experience, with expertise in NLP or computer vision and deep-learning frameworks.
Hudl
Barcelona, SpainBuild and operate edge MLOps infrastructure for smart-camera machine-learning systems, including model deployment, TensorRT compilation, fleet updates, telemetry, and reliability. The role requires production MLOps experience, embedded inference optimization, and strong collaboration with data-science and embedded-engineering teams.
Rollstack
United StatesBuild production AI capabilities for automated slide and document generation, working across LLM applications, data analysis, and content generation. The role requires 3+ years in machine learning and NLP, advanced Python, and experience with LLM frameworks and production systems.
OpenAI
London, United Kingdom
Build and deploy AI-powered products for digital-native customers, taking systems from experimentation through production and scale. The role requires strong Python skills, hands-on production engineering, systematic AI evaluation, and the ability to navigate reliability, security, governance, and customer impact.