Staff AI Engineer - AI Platform
Builds scalable AI platform services for deploying and managing LLMs, integrates with providers like OpenAI and Anthropic, and applies AI to enhance product features. Requires deep backend expertise, distributed systems, and MLOps experience.
About the job
Key Responsibilities
- Architect, design, and implement scalable AI platform services that support the deployment, orchestration, and lifecycle management of LLMs and other AI models.
- Apply LLMs and other AI technologies directly to build and enhance ClickUp’s intelligent features, working closely with product and engineering teams to deliver impactful solutions.
- Build and maintain robust APIs and backend systems that enable seamless integration of AI-powered features into ClickUp’s core platform.
- Develop infrastructure for model serving, monitoring, logging, and automated evaluation to ensure high reliability and performance of AI services in production.
- Integrate with multiple LLM providers (e.g., OpenAI, Anthropic, Google) and manage model selection, routing, and fallback strategies for optimal performance and cost.
- Drive the adoption of best practices in AI privacy, security, and compliance, including data anonymization, secure data handling, and regulatory adherence.
- Optimize platform performance, scalability, and cost-efficiency, leveraging cloud-native technologies and distributed systems.
- Stay current with advancements in AI infrastructure, MLOps, and LLM applications, and proactively incorporate relevant innovations into ClickUp’s AI platform.
- Collaborate cross-functionally with product, frontend, and data teams to deliver seamless, reliable, and user-centric AI experiences.
Qualifications
- Extensive experience designing and building scalable AI/ML platforms or infrastructure in a production environment.
- Proven track record of applying LLMs and AI models to real-world product features and user-facing solutions.
- Deep expertise in backend engineering, distributed systems, and cloud-native technologies (e.g., Kubernetes, Docker, AWS/GCP/Azure).
- Proven experience integrating and managing multiple LLMs and AI models, with a strong understanding of their operational requirements and limitations.
- Proficiency in orchestration frameworks and workflow engines (e.g., LangGraph, Airflow, Kubeflow, Ray).
- Strong programming skills in Python, Go, TypeScript or similar languages used for backend and AI platform development.
- Experience with MLOps best practices, including model deployment, monitoring, logging, and automated evaluation.
- Demonstrated ability to address AI privacy and security challenges, including data anonymization and compliance with data protection regulations.
- Familiarity with search technologies and their integration into AI-driven applications.
Skills
LLMs, Python, Go, TypeScript, Kubernetes, Docker, AWS, GCP, Azure, MLOps, LangGraph, Airflow, Kubeflow, Ray, OpenAI
Similar jobs
ML Engineering jobs
Haus
Seattle, WAStaff Machine Learning Engineer building and operating production ML systems for causal marketing measurement, optimization, and planning. The role requires deep statistical and machine learning expertise, production programming experience, cross-functional collaboration, and technical mentorship.
Scale AI
San Francisco, CAStaff engineer responsible for designing and scaling the infrastructure, execution environments, verifiers, and tooling used to train and evaluate AI agents. Requires 8+ years of software engineering experience, strong Python and distributed-systems expertise, and familiarity with sandboxing, high-throughput systems, and LLM workflows.
Airbnb
United States
Senior Staff ML Engineer fine-tunes and optimizes state-of-the-art LLMs for Airbnb's customer support AI products, including AI assistants and autonomous agents. Partners cross-functionally to productionize models at scale. Requires PhD and 10+ years experience with PyTorch.
United States
Leads the technical direction of large-scale ML infrastructure for embedding, recommendation, and personalization systems. The role requires 8+ years of ML engineering experience, expertise in deep learning and distributed training, and strong leadership across research, infrastructure, and production deployment.
Snowflake
Bellevue, WA
Leads the roadmap and technical vision for Snowflake Feature Store, building reliable, high-performance machine learning platform capabilities and supporting technical execution across partner teams. Requires 10+ years of experience with data-serving infrastructure or ML platforms, plus Java and Python expertise.