Senior AI Architect, AgentOS & LLM Platform

DoubleVerify

New York (NY)

Hybrid

USD 131,000 - 241,000

Full time

44 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

DoubleVerify in New York City is seeking a Senior AI Engineer to join the Pinnacle AI team. You will design and implement AI agents in AgentOS, build MCP servers, and enable AI-powered analysis of advertising data for Fortune 500 clients.

The role requires 5+ years of software engineering and 2+ years with LLM-based apps, plus strong Python, LangChain/LangGraph experience, and collaboration with product, UX, and data science.

Qualifications

5+ years of professional software engineering experience.
2+ years building LLM-based applications or AI agent systems.
Experience shipping AI-powered features end-to-end.

Responsibilities

Design, build, and maintain AI agents within the AgentOS framework.
Develop MCP servers and tools exposing analytics to AI agents.
Implement multi-turn conversational flows and tool-use reasoning chains.
Build chat UI integration with Pinnacle front-end.
Work with LLM providers to select and integrate models.
Develop prompt engineering strategies and retrieval-augmented generation pipelines.
Implement eval frameworks and observability for AI features.
Collaborate with Product, UX, and Data Science; support QE testing.

Skills

LangChain/LangGraph experience

Python proficiency

Problem solving

Clear communication

Team collaboration

Education

BS/MS in Computer Science, ML, AI

Tools

MCP servers

LLM APIs

FastAPI

Docker/Kubernetes

Keycloak/IAM

Job description

The role requires 5+ years of software engineering and 2+ years with LLM-based apps, plus strong Python, LangChain/LangGraph experience, and collaboration with product, UX, and data science.

Get your free, confidential resume review.

or drag and drop your file here.