Product Solutions Architect 3 - LLM Observability
Designs architectures and provides technical guidance for Datadog's LLM Observability product to help enterprise customers monitor and optimize LLM applications. Requires strong software engineering experience with LLMs, observability concepts, and Python/JavaScript.
About the job
What You’ll Do
- Serve as the in-house subject matter expert for Datadog’s LLM Observability product
- Partner with Field teams to provide hands-on technical and architectural guidance to enterprise customers adopting LLM Observability
- Create high-impact technical collateral, including reference architectures, technical guides, cookbooks, and documentation to enable Field teams and the broader customer community
- Build proofs of concept and small-scale deployments to validate solutions and reproduce real-world customer environments
- Act as a trusted advisor to Product Management by delivering actionable feedback informed by real-world field experience
Who You Are
- Strong software engineering foundation, with hands-on experience building and operating LLM-powered applications in production environments, comfortable diving deep into codebases
- Familiar with distributed systems and core observability concepts (tracing, metrics, logging), translating to LLM observability (LLM spans, evaluations, prompt templates)
- Experience with languages such as Python and/or JavaScript/TypeScript
- Comfortable operating in rapidly evolving, ambiguous technical domains
- Build deep context across teams and translate it into reusable, scalable solutions
- Take ownership from problem definition through implementation and measurable outcomes
- Highly detail-oriented, particularly when working on architectures and customer-facing technical assets
- Strong listening and consultative skills, experienced supporting customers in high-pressure, complex situations
Bonus Points
- Successful track record with 5+ years experience working as an Architect or Consultant
- Experience using Datadog and/or other observability tools in an SRE or DevOps capacity
- Experience with LLM application evaluation and testing frameworks
Skills
Llm Observability, Python, JavaScript, TypeScript, Distributed Systems, Tracing, Metrics, Logging, Datadog, SRE
Similar jobs
Solutions Architecture jobs
Redis
United States
Develop Redis-powered solutions for enterprise customers, lead technical evaluations and pilots, and partner with Sales on account strategy. Requires 3+ years of pre-sales engineering experience, server-side development and Linux expertise, distributed-systems experience, and strong communication skills.
Vitalize
San Francisco, CA
Leads on-site deployments for hospital staffing software, mapping workflows, driving adoption across clinical and ops teams, and building scalable rollout playbooks to activate revenue and ROI.
SnapLogic
United States
Advises enterprise customers on AI adoption by identifying use cases, building prototypes, proving business value, and guiding deployment strategy. Requires hands-on customer advisory experience, strong executive communication, enterprise integration knowledge, and solid AI/LLM expertise.
LangChain
San Francisco, CABuild and deliver production AI agent systems for enterprise customers through architecture advising, co-development, and embedded engineering engagements. Requires 4+ years of software engineering experience, deep Python expertise, and 2+ years shipping production agent systems.
Figma
United States
Build and deploy Figma-powered, AI-assisted workflows for strategic enterprise customers, solving complex integration and adoption challenges across codebases, design systems, and developer environments. The role requires 5+ years of end-to-end production engineering experience, strong customer partnership skills, and proficiency in TypeScript, JavaScript, or Python.