# Product Solutions Architect 3 - LLM Observability

**Company:** [Datadog](https://hotfix.jobs/companies/datadog)
**Location:** Boston, MA, New York, NY, San Francisco, CA
**Role:** Solutions Architecture
**Salary:** $152k – $222k/yr
**Experience:** 5+ years
**Skills:** Llm Observability, Python, JavaScript, TypeScript, Distributed Systems, Tracing, Metrics, Logging, Datadog, SRE
**Posted:** 2026-02-19

> Designs architectures and provides technical guidance for Datadog's LLM Observability product to help enterprise customers monitor and optimize LLM applications. Requires strong software engineering experience with LLMs, observability concepts, and Python/JavaScript.

## Job Description

## What You’ll Do
- Serve as the in-house subject matter expert for Datadog’s LLM Observability product
- Partner with Field teams to provide hands-on technical and architectural guidance to enterprise customers adopting LLM Observability
- Create high-impact technical collateral, including reference architectures, technical guides, cookbooks, and documentation to enable Field teams and the broader customer community
- Build proofs of concept and small-scale deployments to validate solutions and reproduce real-world customer environments
- Act as a trusted advisor to Product Management by delivering actionable feedback informed by real-world field experience

## Who You Are
- Strong software engineering foundation, with hands-on experience building and operating LLM-powered applications in production environments, comfortable diving deep into codebases
- Familiar with distributed systems and core observability concepts (tracing, metrics, logging), translating to LLM observability (LLM spans, evaluations, prompt templates)
- Experience with languages such as **Python** and/or **JavaScript/TypeScript**
- Comfortable operating in rapidly evolving, ambiguous technical domains
- Build deep context across teams and translate it into reusable, scalable solutions
- Take ownership from problem definition through implementation and measurable outcomes
- Highly detail-oriented, particularly when working on architectures and customer-facing technical assets
- Strong listening and consultative skills, experienced supporting customers in high-pressure, complex situations

## Bonus Points
- Successful track record with 5+ years experience working as an Architect or Consultant
- Experience using Datadog and/or other observability tools in an SRE or DevOps capacity
- Experience with LLM application evaluation and testing frameworks

## Similar roles

- [Solutions Consultant, Post Sales, Mid-Market](https://hotfix.jobs/jobs/7f46f095-4a1e-4efd-ba21-b52a42c64b87) - Ramp - Remote - $151k – $231k/yr
- [Solutions Engineer](https://hotfix.jobs/jobs/ac7ba6b7-a1d0-4df5-b3e4-7267ad799c6c) - Scale AI - San Francisco, CA - $152k – $190k/yr
- [Forward Deployed Engineer](https://hotfix.jobs/jobs/bd4fccdf-2d4a-45a6-8c13-ee6c40dd3f27) - Figma - San Francisco, CA - $153k – $296k/yr
- [Forward Deployed Engineer](https://hotfix.jobs/jobs/35f42f5c-2c95-4f36-99a8-78ce9ea1e992) - Beacon Biosignals - Boston, MA - $150k – $170k/yr
- [Forward Deployed Engineer](https://hotfix.jobs/jobs/42525125-557e-4790-ae83-f445a0bad8b6) - Stuut - New York, NY - $150k – $240k/yr

**Apply:** https://hotfix.jobs/jobs/c0cadd11-0707-42f1-881e-6885175ee499
**Canonical:** https://hotfix.jobs/jobs/c0cadd11-0707-42f1-881e-6885175ee499