Senior AI Engineer - AI Platform
Builds scalable AI platform backend for deploying and managing LLMs, integrates with providers like OpenAI/Anthropic/Google, and applies AI to enhance product features. Requires deep backend expertise, MLOps, cloud-native tech, and production AI experience.
About the job
Key Responsibilities
- Architect, design, and implement scalable AI platform services that support the deployment, orchestration, and lifecycle management of LLMs and other AI models.
- Apply LLMs and other AI technologies directly to build and enhance ClickUp’s intelligent features, working closely with product and engineering teams to deliver impactful solutions.
- Build and maintain robust APIs and backend systems that enable seamless integration of AI-powered features into ClickUp’s core platform.
- Develop infrastructure for model serving, monitoring, logging, and automated evaluation to ensure high reliability and performance of AI services in production.
- Integrate with multiple LLM providers (e.g., OpenAI, Anthropic, Google) and manage model selection, routing, and fallback strategies for optimal performance and cost.
- Drive the adoption of best practices in AI privacy, security, and compliance, including data anonymization, secure data handling, and regulatory adherence.
- Optimize platform performance, scalability, and cost-efficiency, leveraging cloud-native technologies and distributed systems.
- Stay current with advancements in AI infrastructure, MLOps, and LLM applications, and proactively incorporate relevant innovations into ClickUp’s AI platform.
- Collaborate cross-functionally with product, frontend, and data teams to deliver seamless, reliable, and user-centric AI experiences.
Qualifications
- Extensive experience designing and building scalable AI/ML platforms or infrastructure in a production environment.
- Proven track record of applying LLMs and AI models to real-world product features and user-facing solutions.
- Deep expertise in backend engineering, distributed systems, and cloud-native technologies (e.g., Kubernetes, Docker, AWS/GCP/Azure).
- Proven experience integrating and managing multiple LLMs and AI models, with a strong understanding of their operational requirements and limitations.
- Proficiency in orchestration frameworks and workflow engines (e.g., LangGraph, Airflow, Kubeflow, Ray).
- Strong programming skills in Python, Go, TypeScript or similar languages used for backend and AI platform development.
- Experience with MLOps best practices, including model deployment, monitoring, logging, and automated evaluation.
- Demonstrated ability to address AI privacy and security challenges, including data anonymization and compliance with data protection regulations.
- Familiarity with search technologies and their integration into AI-driven applications.
- Excellent collaboration and communication skills, with a track record of working effectively in cross-functional teams.
Skills
LLMs, Python, Kubernetes, Docker, MLOps, AWS, GCP, Azure, LangGraph, Airflow, Kubeflow, Ray, Go, TypeScript, Distributed Systems
Similar jobs
ML Engineering jobs
Traba
New York, NYBuild and deploy production AI-agent systems, including their harnesses, evaluations, orchestration, and supporting services. The role requires 5+ years of software engineering experience, production LLM or agent experience, and strong Python or TypeScript/Node.js skills.
Metriport
San Francisco, CA
Own machine learning end to end, from modeling messy clinical data through production deployment, monitoring, and infrastructure. The role requires 7+ years of experience building scalable ML systems, strong software and data engineering skills, and proficiency with Python, SQL, and cloud platforms.
SentiLink
United States
Leads and manages an applied machine learning team developing production fraud detection and identity verification models. The role combines people leadership with hands-on technical work and requires substantial ML experience, production deployment expertise, and experience in risk-focused domains.
Airbnb
United States
Builds and productionizes machine learning systems for trust and safety, including abuse detection, autonomous AI agents, and evaluation frameworks. The role requires 5+ years of applied ML experience, strong Python skills, experience with LLMs and scalable pipelines, and a relevant advanced degree or equivalent background.
6sense
San Francisco, CA
Owns end-to-end production machine learning systems, including NLP, LLM, agentic, ranking, and recommendation capabilities. Requires 8+ years of industry experience, strong Python and cloud ML expertise, and the ability to deliver explainable AI products with cross-functional and customer impact.