Skip to content
PointClickCarePointClickCareUnited States

Principal AI Platform Engineer (US)

Build and maintain core GenAI infrastructure including model gateways, vector databases, observability tools, and integration with agent workflows. Requires extensive AI platform experience, Kubernetes, OpenTelemetry/MLFlow, and preferred LLM serving frameworks.

179k – 199k/yr
Remote7+ YOEML Engineering

About the role

Key Responsibilities

  • Design, build, and maintain the core infrastructure layer supporting GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools.
  • Implement secure access controls and authentication mechanisms integrated by default into the AI platform components.
  • Develop and manage observability, monitoring, and logging solutions for GenAI workloads and infrastructure.
  • Collaborate closely with product and engineering teams to integrate GenAI infrastructure with agent frameworks, and downstream applications.
  • Optimize infrastructure for scalability, high availability, cost efficiency for production workloads.

Qualifications & Skills

  • Extensive experience building and maintaining AI platform infrastructure, Kubernetes, and container security.
  • Demonstrated expertise in observability, and monitoring frameworks, with a focus on real-time performance (i.e: experience with OpenTelemetry, MLFlow).
  • Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.

Preferred Experience

  • Familiarity with vLLM, SGLang or similar framework to host LLM inference workloads.
  • Experience with CI/CD pipelines and automation for AI model deployment and platform operations.
  • Strong knowledge of authentication and authorization frameworks integrated into AI platforms.

Skills

KubernetesOpenTelemetryMLflowvLLMSglangCI/CDAi Platform InfrastructureVector DatabasesLlm InferenceContainer Security

Similar roles

ML Engineering jobs
Armis

Principal Machine Learning Engineer

ArmisUnited States

Build and optimize AI/ML pipelines for data processing, model training, and deployment. Collaborate with data scientists to implement scalable AI solutions on cloud infrastructure.

184k – 250k/yr
Remote7+ YOEML Engineering
Astera

Principal Software Engineer, Neuroscience Platforms

AsteraEmeryville, CA

Lead development of computational infrastructure for large-scale neuroscience research, building real-time stimulus/acquisition systems, high-throughput data pipelines, and cloud tools. Requires exceptional full-stack engineering with real-time systems experience; neuroscience background not required.

200k – 350k/yr
On-site7+ YOEML Engineering
Formation Bio

Principal Data Scientist, Medical Imaging

Formation BioNew York, NY +1

Lead development of deep learning models for medical image analysis (MRI, X-ray) to accelerate clinical trials, create AI biomarkers, and integrate imaging AI into drug development workflows. Requires PhD and 5+ years building production-grade medical imaging AI.

205k – 267k/yr
Hybrid5+ YOEML Engineering
Shippo

Principal Machine Learning Engineer, ML Platform

ShippoUnited States

Principal ML Platform Engineer builds production ML infrastructure for shipping logistics ML (prediction, fraud, optimization). Requires 15+ years engineering, 4+ years ML production systems, Kubernetes/MLflow expertise.

212k – 287k/yr
Remote15+ YOEML Engineering
Upstart

Principal Machine Learning Engineer

UpstartUnited States

Leads engineering initiatives to build scalable ML platform infrastructure, including unified embeddings, feature pipelines, and continuous learning systems. Requires 7+ years in applied ML, Python/ML frameworks expertise, and Master's/PhD in quantitative field.

221k – 300k/yr
Remote7+ YOEML Engineering