Senior LLM Observability Solutions Architect

Datadog; New York (NY); On-site; USD 167,000 - 244,000; Full time

Benefits offered by this job

RSUs

Employee Stock Purchase Plan (ESPP)

Generous global benefits

Mentor and buddy program

Job summary

Datadog’s Product Solutions Architects design architectures and best practices for LLM Observability, partnering with field teams to accelerate adoption across customer environments.

You will build reference architectures, technical guides, and cookbooks, and drive customer success at scale while translating field feedback into product improvements. This role requires hands‑on coding, deep systems knowledge, and travel to client sites.

Qualifications

• Strong software engineering foundation with hands‑on experience building and operating production systems.
• Familiar with tracing, metrics, and logging; can translate patterns to LLM observability.
• Proficiency in Python and/or JavaScript/TypeScript.
• Able to work in a fast-evolving, ambiguous domain and own problems end‑to‑end.

Responsibilities

• Serve as the in‑house subject matter expert for Datadog’s LLM Observability product.
• Provide hands-on architectural guidance to enterprise customers adopting LLM Observability.
• Create high‑impact collateral: reference architectures, guides, cookbooks, and docs.
• Build proofs of concept and small deployments to validate solutions in real customer environments.
• Deliver actionable feedback to Product Management based on field experience.

Skills

Python

JavaScript/TypeScript

Distributed systems

Observability

Code quality

Education

Bachelor's degree in Computer Science or equivalent

Tools

Datadog

SRE/DevOps tooling

Job description

Datadog’s Product Solutions Architects design architectures and best practices for LLM Observability, partnering with field teams to accelerate adoption across customer environments.

You will build reference architectures, technical guides, and cookbooks, and drive customer success at scale while translating field feedback into product improvements. This role requires hands‑on coding, deep systems knowledge, and travel to client sites.