Lead PM, AI Agent Runtime & Evaluations (Remote)

Juniper Square

Seattle (WA)

Remote

USD 200,000 - 230,000

Full time

45 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health, dental, and vision care
Life insurance
Fertility and growing family support
Flex Time Off
Paid family leave, medical leave, and
Retirement saving plans
Allowance to customize your work setup
Annual professional development

Job summary

Juniper Square is seeking a Lead Product Manager to own the agent runtime and evaluation layer of Foundry, a platform that enables non-engineers to describe needs and deploy governed automations. You’ll work with an engineering team to ship features with identity, access, and audit trails.

You’ll balance governance, model evaluations, and workflows, shaping the future of an AI-driven fund administration platform used by leading GPs worldwide.

Qualifications

  • 7+ years of product management experience in B2B or Enterprise SaaS.
  • Experience owning a complex product area end-to-end in zero-to-one context.
  • Hands-on understanding of agent evaluation, golden datasets, automated judges, and regression testing.

Responsibilities

  • Build the agent runtime: define vision, strategy, and roadmap for a platform enabling non-engineers to deploy governed automations.
  • Own evaluations and model governance: determine when models are eligible for specific agents and when human review is needed.
  • Shape memory and self-improvement: define how agents store memory and learn from experience.
  • Deliver configuration to business SMEs: build tools SMEs use to configure and tune automations.
  • Stay ahead of the market: track agent runtimes and make build/buy/partner calls.
  • Be a leader: set direction and earn engineering trust on platform tradeoffs.

Skills

AI fluency
PM leadership
LLMs
Agent orchestration

Tools

Claude Managed Agents
Workato Genies

Job description

Juniper Square is seeking a Lead Product Manager to own the agent runtime and evaluation layer of Foundry, a platform that enables non-engineers to describe needs and deploy governed automations. You’ll work with an engineering team to ship features with identity, access, and audit trails.

You’ll balance governance, model evaluations, and workflows, shaping the future of an AI-driven fund administration platform used by leading GPs worldwide.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead PM, AI Agent Runtime & Evaluations (Remote)
Lead PM, AI Agent Runtime & Evaluations (Remote)

Juniper Square • Denver (CO)

Remote
USD 200,000 - 230,000
Health benefits
Retirement plan
Flexible time off
+1
Lead Product Manager, AI Agent Runtime & Evaluations
Lead Product Manager, AI Agent Runtime & Evaluations

Juniper Square • Dallas (TX)

Remote
USD 200,000 - 230,000
Health, dental, vision
Life insurance
Mental wellness coverage
+6
Lead Product Manager, AI Agent Runtime & Evaluations
Lead Product Manager, AI Agent Runtime & Evaluations

Juniper Square • Chicago (IL)

Remote
USD 140,000 - 190,000
Lead Product Manager – Agent Runtime & AI Evaluations
Lead Product Manager – Agent Runtime & AI Evaluations

junipersquare • United States

Remote
USD 150,000 - 210,000
Lead Product Manager — AI Agent Runtime & Evaluations
Lead Product Manager — AI Agent Runtime & Evaluations

Juniper Square • United States

Remote
USD 200,000 - 230,000
Health, dental, vision
Life insurance
Mental wellness coverage
+2
Lead Product Manager, Agent Runtime & Evals
Lead Product Manager, Agent Runtime & Evals

Juniper Square • Chicago (IL)

Remote
USD 140,000 - 190,000
Remote Senior PM, AI Governance & Automation
Remote Senior PM, AI Governance & Automation

Juniper Square • United States

Hybrid
USD 180,000 - 260,000
Health insurance
Dental insurance
Vision insurance
+3
Lead Product Manager, Agent Runtime & Evals
Lead Product Manager, Agent Runtime & Evals

junipersquare • United States

Remote
USD 150,000 - 210,000
Lead Product Manager, Agent Runtime & Evals
Lead Product Manager, Agent Runtime & Evals

Juniper Square • Denver (CO)

Remote
USD 200,000 - 230,000
Health benefits
Retirement plan
Flexible time off
+1
Lead Product Manager, Agent Runtime & Evals
Lead Product Manager, Agent Runtime & Evals

Juniper Square • Seattle (WA)

Remote
USD 200,000 - 230,000
Health, dental, and vision care
Life insurance
Fertility and growing family support
+5