Engineering Manager, AI-Native LLM & Agents

Triwill Group; Northern, New York (KY, NY); Hybrid; USD 192,000 - 240,000; Full time

Benefits offered by this job

RSUs

ESPP

Professional development

Mentor program

Inclusion culture

Inclusion Talks

Mental health benefits

Global benefits

Job summary

Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers.

Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables teams to move faster with clarity and confidence.

Qualifications

• Hands-on experience shipping scaled LLM software including APIs and agent frameworks.
• Experience building prompt and eval tooling for autonomous systems.
• Proven ability to lead a team delivering customer-facing AI products.

Responsibilities

• Lead and develop an existing engineering team, setting technical direction and ownership.
• Own the roadmap across source code indexing, PR Agentic Reviewers, shift-left work, and evaluation systems.
• Partner with product teams and customers to translate needs into direction.
• Build and operate scaled LLM and agent software in production including APIs, frameworks, harness, and eval tooling.
• Drive safety, validation, and agent autonomy improvements over time.

Skills

LLM software

Agent frameworks

Prompt tooling

Eval tooling

Closed-loop eval

LLM-as-judge

Tools

LLM APIs

Harness

Tool-use

Job description

Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers.

Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables teams to move faster with clarity and confidence.