Skip to content
FivetranFivetranOakland, CA

Sr. Principal AI Systems Architect

Designs and owns architecture for production-grade AI analyst systems, including prompts, tools, context, evaluation, and safety. Partners with teams to build reliable AI capabilities for analytical workflows, emphasizing scalability and quality.

252k – 315k/yr
HybridML Engineering

About the role

What You'll Do

  • Define the architecture for the analyst AI stack across prompts, tools, metadata, memory and context strategies, evaluation, and runtime safety.
  • Build the abstractions and interfaces that allow product teams to add new agent capabilities without creating brittle prompt sprawl.
  • Design retrieval and context strategies that give the model the right information at the right time with strong cost, latency, and quality tradeoffs.
  • Establish evaluation loops, benchmark suites, and review processes so model behavior can be measured, debugged, and improved systematically.
  • Partner with product, engineering, and analyst-domain experts to translate real analytical workflows into robust AI-assisted product capabilities.
  • Drive quality standards around correctness, trust, transparency, and failure handling in analyst-facing AI experiences.

What We're Looking For

  • Deep experience building AI-enabled product systems, not just running experiments.
  • Strong software architecture skills, especially around APIs, contracts, orchestration, and system boundaries.
  • Practical understanding of LLM prompting, tool use, retrieval, structured outputs, and evaluation methods.
  • Ability to work fluently across backend engineering, product constraints, and user workflow design.
  • Clear judgment about where agent systems should be flexible and where they should be constrained.
  • Comfort working in ambiguous environments where patterns are still being invented.

Perks and Benefits

  • 100% employer-paid medical insurance*
  • Generous paid time-off policy (PTO), plus paid sick time, inclusive parental leave policy, holidays, and volunteer days off
  • RSU stock grants*
  • Professional development and training opportunities
  • Company virtual happy hours, free food, and fun team-building activities
  • Monthly cell phone stipend
  • Access to an innovative mental health support platform

Skills

Llm PromptingTool UseRetrievalStructured OutputsEvaluation MethodsAPIsOrchestrationPrompt EngineeringContext StrategiesAgent SystemsMetadata ContractsRuntime Safety

Similar roles

ML Engineering jobs
Redpanda Data

Principal Software Engineer, AI Platform

Redpanda DataSan Francisco, CA

Principal engineer architecting and building Redpanda's Agentic Data Plane, enabling AI agents to safely interact with enterprise data via streaming, query, and governance layers. Requires 10+ years building large-scale distributed systems and experience with agentic AI infrastructure.

245k – 290k/yr
Hybrid10+ YOEML Engineering
Pinterest

Principal Engineer, AI Platform

PinterestSan Francisco, CA

Principal Engineer setting technical vision and building AI/ML infrastructure for Generative AI and Recommender Systems at Pinterest, scaling to hundreds of millions of inferences per second. Requires deep expertise in distributed systems and proven cross-org technical leadership.

243k – 500k/yr
Hybrid7+ YOEML Engineering
Shield AI

Principal Engineer, State Estimation

Shield AIDallas, TX

Principal State Estimation Engineer developing advanced sensor fusion, inertial navigation, and real-time state estimation algorithms for autonomous UAVs in GPS-denied environments. Requires 12+ years experience with Kalman filters, C++, and shipping navigation products.

275k – 412k/yr
On-site12+ YOEML Engineering
character.ai

Principal Research Engineer, Post-Training

character.aiRedwood City, CA

Lead technical vision and execution for post-training systems that transform foundation models into intelligent, engaging products. Drive alignment algorithms, RL, and infrastructure for large-scale LLM training and serving.

275k – 400k/yr
On-site7+ YOEML Engineering
Everlaw

Staff/Principal AI Engineer

EverlawOakland, CA

Leads design and execution of AI strategy for legal discovery platform, guiding engineering teams on LLMs, NLP, and frontier models at massive scale. Requires 6+ years ML/AI experience and 10+ years software engineering.

228k – 340k/yr
Hybrid6+ YOEML Engineering