Principal Product Manager

Zeta Global; Atlanta (GA); On-site; USD 185,000 - 205,000; Full time

Benefits offered by this job

Unlimited PTO

Excellent medical, dental, and vision

Employee Equity

Employee Discounts

Virtual Wellness Classes

Pet Insurance

Job summary

Zeta Global is seeking a Senior Product Manager to lead agentic systems across LLMs, workflows, and developer platforms. You will define context graphs, orchestration patterns, and telemetry to ensure reliable, scalable experiences for enterprise customers.

This role requires cross-functional influence across product, engineering, data science, and security, with a focus on governance and measurable improvements to agent performance within Zeta's AI-powered marketing cloud.

Qualifications

• Proven experience leading complex technical products involving LLMs, AI agents, workflows, or ML infrastructure.
• Strong understanding of LLM agents, tool use, orchestration, and multi-agent workflows at scale.
• Experience designing context graphs, semantic memory systems, and knowledge graphs to connect users, data, and actions.
• Ability to define telemetry signals and observability for production AI systems and to build evaluation loops for improvement.
• Exceptional ability to align senior stakeholders around shared architecture and operating standards.
• Systems thinking approach to tie product, model behavior, data, and infrastructure together.
• Hands-on technical background with APIs, agent tooling, and modern AI development tools.
• Strong problem-solving, prototyping, and the ability to translate experiments into decisions.
• Excellent communication and collaboration across technical and non-technical teams.

Responsibilities

• Develop and manage architecture for chaining LLM agents, tools, models, and workflows across use cases.
• Lead the design of a shared Context Graph for persistent user/brand/activity awareness.
• Implement and manage real-time context streaming services for multi-step workflows.
• Define telemetry framework to analyze agent routing, tool usage, context, and outcomes.
• Build evaluation suites to test agent quality, reliability, and end-to-end completion.
• Lead the Model Workbench to enable non-technical users to leverage LLMs safely.
• Oversee MCP: protocol servers, tools, agents, and capability governance.
• Drive cross-functional alignment among Product, Engineering, Data Science, and Security.
• Troubleshoot and prototype rapidly using LangSmith and observability platforms.
• Promote rapid iteration and vibi coding to validate ideas quickly.

Skills

Product management

Agentic systems

Context & knowledge architecture

Telemetry & observability

Stakeholder alignment

Systems thinking

Technical proficiency

Prototyping & problem solving

Communication & collaboration

Tools

LangSmith

APIs

Workflow orchestration

MCP

Evaluation frameworks

Job description

Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI. Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world. To learn more, go to www.zetaglobal.com.

Role Responsibilities

WHO WE ARE

Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI. Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world. To learn more, go to www.zetaglobal.com.

• Agent Chaining and Orchestration: Develop and manage the architecture for chaining LLM agents, tools, models, and workflows across complex use cases. Ensure seamless orchestration, handoffs, state management, and integration across the platform.

• Context Graph and Context Architecture: Lead the development of a shared Context Graph that gives agents persistent awareness of users, brands, accounts, workflows, capabilities, data, prior actions, goals, and outcomes. Define how context is captured, structured, retrieved, governed, and made available across agents and products.

• Context Streaming Services: Implement and manage context streaming services that provide agents with real-time awareness of user actions, application state, system events, and relevant business data. Ensure context remains current, permission-aware, and usable across multi-step workflows.

• Agent Telemetry and Observability: Define the telemetry framework required to understand how agents operate in production. Instrument and analyze intent routing, agent and tool selection, context utilization, handoffs, latency, errors, completion rates, confidence, user interventions, and business outcomes. Build the feedback loops necessary to continuously improve agent performance.

• Agent Evaluation Suites: Build robust evaluation frameworks for testing agent quality, reliability, routing, context utilization, tool execution, and end-to-end workflow completion. Establish both offline and production evaluation methodologies that enable measurable improvements over time.

• Model Workbench Development: Lead the creation of a Model Workbench designed for marketers and other non-technical users, enabling them to safely leverage LLMs, traditional ML, agents, and workflows without requiring deep technical expertise.

• MCP Capability and Tool Registry: Oversee the registration, documentation, governance, and discoverability of Model Context Protocol servers, tools, agents, and platform capabilities. Ensure capabilities are easy for both developers and agents to understand, select, and invoke correctly.

• Cross-Functional Architecture and Organizational Alignment: Drive alignment across Product, Engineering, Data Science, Design, Analytics, Security, and business stakeholders around shared agentic architecture, context standards, ownership models, evaluation criteria, and platform priorities. Establish clear accountability and operating models for capabilities that span multiple teams.

• Platform Standards and Governance: Define standards for how agents, tools, context sources, telemetry, and workflows are built and integrated across the organization. Balance local team autonomy with the consistency required to create a coherent platform experience.

• Technical Troubleshooting and Prototyping: Actively participate in troubleshooting and debugging using tools such as LangSmith and related observability platforms. Lead by example by rapidly building proof-of-concepts to validate technical approaches, identify architectural constraints, and demonstrate new product opportunities.

• Advocacy for Rapid Iteration: Promote a culture of rapid prototyping, experimentation, and evidence-based iteration. Use lightweight development and “vibe coding” where appropriate to quickly turn ideas into working experiences before investing in production-scale implementations.

Required Qualifications

• Product Management Experience: Demonstrated experience leading complex technical products, particularly those involving LLMs, AI agents, workflow systems, developer platforms, ML infrastructure, or AI-driven applications.

• Agentic Systems Expertise: Strong understanding of LLM agents, tool use, orchestration, multi-agent workflows, state management, context management, and the architectural patterns required to operate agentic systems reliably at scale.

• Context and Knowledge Architecture: Experience designing or working with context graphs, knowledge graphs, semantic systems, memory architectures, metadata platforms, or other systems that allow applications and models to understand relationships between users, data, actions, and business objects.

• Telemetry and Observability: Strong understanding of instrumentation, telemetry, evaluation, and observability for complex software or AI systems. Ability to define the signals required to distinguish between model failures, orchestration failures, context failures, tool failures, and UX failures.

• Organizational Alignment and Influence: Exceptional ability to align senior stakeholders and cross-functional teams around shared technical architecture, product priorities, ownership boundaries, and operating standards. Comfortable leading initiatives where no single team controls the entire outcome.

• Systems Thinking: Ability to reason across product experience, model behavior, data, infrastructure, APIs, organizational ownership, and operational processes rather than optimizing individual components in isolation.

• Technical Proficiency: Strong technical background with hands‑on familiarity with tools such as LangSmith and experience working with APIs, workflow orchestration, LLM agent chaining, MCP, evaluation frameworks, and modern AI development environments.

• Problem‑Solving and Prototyping: Demonstrated ability to troubleshoot ambiguous technical problems, rapidly prototype potential solutions, and translate experimentation into scalable product and architectural decisions.

• Communication and Collaboration: Excellent communication skills with the ability to translate highly technical concepts into clear product strategies, operating models, and decisions for technical and non‑technical audiences.

Preferred Qualifications

• Experience building or operating agentic infrastructure, AI platforms, context platforms, knowledge graphs, or developer ecosystems.

• Experience integrating traditional machine learning with generative models and agentic systems, including using predictive models as tools or contextual inputs for agents.

• Experience with workflow orchestration platforms and distributed systems involving multiple services, teams, and execution environments.

• Experience designing AI telemetry, evaluation systems, experimentation frameworks, or production observability for LLM-powered products.

• Demonstrated success establishing cross‑functional technical standards and governance across multiple engineering and product organizations.

• Experience building systems where context, telemetry, and evaluation form a continuous learning loop, allowing agent behavior and product experiences to improve based on real‑world usage.

BENEFITS & PERKS

• Unlimited PTO
• Excellent medical, dental, and vision coverage
• Employee Equity
• Employee Discounts, Virtual Wellness Classes, and Pet Insurance And more!!

SALARY RANGE

The salary range for this role is $185,000 - $205,000, depending on location and experience.

PEOPLE & CULTURE AT ZETA

Zeta considers applicants for employment without regard to, and does not discriminate on the basis of an individual’s sex, race, color, religion, age, disability, status as a veteran, or national or ethnic origin; nor does Zeta discriminate on the basis of sexual orientation, gender identity or expression.

We’re committed to building a workplace culture of trust and belonging, so everyone feels invited to bring their whole selves to work. We provide a forum for employees to celebrate, support and advocate for one another. Learn more about our commitment to diversity, equity and inclusion here: https://zetaglobal.com/blog/a-look-into-zetas-ergs/

ZETA IN THE NEWS!

https://zetaglobal.com/press/?cat=press-releases