AI Observability Architect for Enterprise Agentic Systems

PepsiCo; Purchase (NY); On-site; USD 180,000 - 206,750; Full time

Benefits offered by this job

Bonus 15%

Paid time off

Comprehensive benefits

Job summary

PepsiCo is seeking an AI Observability Architect to design and deploy a production-grade observability platform for AI agents, LLM workflows, and physical AI systems. You will own end-to-end telemetry, tracing, and quality signals across heterogeneous agent frameworks and platforms.

The role leads safety, security, and Responsible AI governance, partnering with RAI, data science, and platform teams to deliver scalable observability, policy enforcement, and incident response across cloud

Qualifications

• Senior technical leader responsible for enterprise-grade AI observability platform design, deployment, and operation.
• Owns OTEL integration across agentic platforms for unified observability and governance.
• Leads safety, security, RAI, and red-teaming initiatives in observability workflows.

Responsibilities

• Define enterprise observability architecture for AI agents, LLMs, and physical AI systems.
• Build and operate telemetry pipelines with metrics, logs, traces, and real-time streaming (Kafka).
• Instrument OTEL across platforms like Salesforce AgentForce, ServiceNow, and Microsoft Agent 365.
• Deliver dashboards, alerts, SLOs/SLAs, runbooks, and RCA tooling to improve reliability.
• Develop security observability playbooks and audit-ready traceability for AI decisions.

Skills

AI Observability

Distributed Systems

OpenTelemetry

Agentic AI Frameworks

Safety & Red Teaming

Reinforcement Learning

Python

MCP

A2A/UCP/AP2 Protocols

Cloud & Kubernetes

Education

Bachelor's or Master's in CS/AI/Data Science

12+ years technology experience

PhD a plus for research-heavy domains

Tools

Kafka

Terraform

Kubernetes

Azure/AWS/GCP

Salesforce/ServiceNow integrations

Job description

PepsiCo is seeking an AI Observability Architect to design and deploy a production-grade observability platform for AI agents, LLM workflows, and physical AI systems. You will own end-to-end telemetry, tracing, and quality signals across heterogeneous agent frameworks and platforms.

The role leads safety, security, and Responsible AI governance, partnering with RAI, data science, and platform teams to deliver scalable observability, policy enforcement, and incident response across cloud