Product Solutions Architect 3 - LLM Observability

What You’ll Do

• Serve as the in-house subject matter expert for Datadog’s LLM Observability product
• Partner with Field teams to provide hands-on technical and architectural guidance to enterprise customers adopting LLM Observability
• Create high-impact technical collateral, including reference architectures, technical guides, cookbooks, and documentation to enable Field teams and the broader customer community
• Build proofs of concept and small-scale deployments to validate solutions and reproduce real-world customer environments
• Act as a trusted advisor to Product Management by delivering actionable feedback informed by real-world field experience

Who You Are

• Strong software engineering foundation, with hands-on experience building and operating LLM-powered applications in production environments, comfortable diving deep into codebases
• Familiar with distributed systems and core observability concepts (tracing, metrics, logging), translating to LLM observability (LLM spans, evaluations, prompt templates)
• Experience with languages such as Python and/or JavaScript/TypeScript
• Comfortable operating in rapidly evolving, ambiguous technical domains
• Build deep context across teams and translate it into reusable, scalable solutions
• Take ownership from problem definition through implementation and measurable outcomes
• Highly detail-oriented, particularly when working on architectures and customer-facing technical assets
• Strong listening and consultative skills, experienced supporting customers in high-pressure, complex situations

Bonus Points

• Successful track record with 5+ years experience working as an Architect or Consultant
• Experience using Datadog and/or other observability tools in an SRE or DevOps capacity
• Experience with LLM application evaluation and testing frameworks