Skip to content
WeaveWeaveUnited States

Principal Engineer - GenAI Applications & MLOps

Lead the design and scaling of ML infrastructure and GenAI platforms at Weave, enabling product teams to deliver AI-powered healthcare communication features. Requires deep expertise in MLOps, LLMs, distributed systems, and cross-team technical leadership.

Salary not listed
Remote12+ YOEML Engineering

About the role

Infrastructure & Delivery

  • Design and develop ML infrastructure, tooling, and models to help teams deliver world-class experiences
  • Build internal and external products and platforms to enable teams to incorporate AI into their features and customer-facing products
  • Translate product goals into actionable engineering plans and build scalable, resilient services for data integration and event processing

Cross-Team Problem Solving

  • Help product and development teams understand the data lifecycle and consult with teams on common ML patterns/tradeoffs
  • Coach and collaborate inside and outside the team to elevate technical standards
  • Write high-quality, performant, sustainable, and testable code while working in a cloud environment

Strategic Technical Leadership

  • Monitor the industry landscape, anticipate where technological advances are heading, and ensure Weave stays ahead of the curve
  • Cut through noise and hype to identify genuine strategic value; advocate for and lead key initiatives that prepare Weave for emerging challenges
  • Shape company-wide standards for engineering excellence, observability, and reliability in distributed systems

Mentorship & Organizational Capability

  • Actively mentor Staff and Senior Engineers across the fellowship, developing the next generation of technical leaders
  • Elevate architectural thinking across teams through design reviews, documentation standards, and hands-on guidance
  • Build organizational capability that persists beyond your individual contributions

What You Will Need

  • 12+ years of software engineering experience with progressive technical leadership scope
  • Demonstrable experience building and deploying ML-driven B2B multi-tenant applications in production environments at scale
  • Deep expertise in distributed systems architecture, including building and operating services that handle hundreds of millions of transactions and terabytes of data
  • 8+ years of experience in Machine Learning or AI, preferably with a focus on natural language
  • Expertise with modern ML tools and techniques such as LLMs, RAG, Prompt Engineering, Fine Tuning, LLM evaluations, multi-modal models
  • Strong background in scalable data stores—both relational (PostgreSQL at scale, Vitess, Spanner) and NoSQL (Bigtable, Redis)
  • Operational experience with cloud-native infrastructure on GCP or AWS, including Kubernetes, infrastructure-as-code, and highly available system design
  • Track record of leading cross-team technical initiatives that delivered measurable business outcomes
  • Demonstrated ability to influence without direct authority, build consensus across organizational boundaries

What Will Make Us Love You

  • Expertise with customer-facing GenAI at scale, in production
  • Expertise building low-latency high-accuracy AI Agents
  • Background in compliance-heavy environments (healthcare, fintech)
  • History of external technical leadership: open source contributions, conference speaking, or published technical writing

Skills

Machine LearningMLOpsLLMsRAGPrompt EngineeringFine TuningKubernetesGCPAWSPostgresDistributed Systems

Similar roles

ML Engineering jobs
OpenAI

Principal Software Engineer, Codex Cyber

OpenAISan Francisco, CA

Principal engineer on OpenAI's Codex Cyber team building AI-powered security products for trusted defenders. Define roadmaps, shape model training and safeguards, build evaluations for cyber capabilities and risks, and translate frontier research into production tools while collaborating across product, research, safety, and external partners.

347k – 490k/yr
On-site10+ YOEML Engineering
Shield AI

Principal Engineer, State Estimation

Shield AIDallas, TX

Principal State Estimation Engineer developing advanced sensor fusion, inertial navigation, and real-time state estimation algorithms for autonomous UAVs in GPS-denied environments. Requires 12+ years experience with Kalman filters, C++, and shipping navigation products.

275k – 412k/yr
On-site12+ YOEML Engineering
Astera

Principal Software Engineer, Neuroscience Platforms

AsteraEmeryville, CA

Lead development of computational infrastructure for large-scale neuroscience research, building real-time stimulus/acquisition systems, high-throughput data pipelines, and cloud tools. Requires exceptional full-stack engineering with real-time systems experience; neuroscience background not required.

200k – 350k/yr
On-site7+ YOEML Engineering
character.ai

Principal Research Engineer, Post-Training

character.aiRedwood City, CA

Lead technical vision and execution for post-training systems that transform foundation models into intelligent, engaging products. Drive alignment algorithms, RL, and infrastructure for large-scale LLM training and serving.

275k – 400k/yr
On-site7+ YOEML Engineering
Highspot

Principal Software Engineer, Applied AI

HighspotSeattle, WA

Principal Software Engineer leading technical direction for Generative AI and Agentic systems at enterprise scale. Owns AI platform architecture, builds evaluation infrastructure, and drives model strategy across the organization.

Salary not listed
Hybrid8+ YOEML Engineering