Lead Product Manager – Agent Runtime & AI Evaluations

junipersquare; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

Juniper Square is seeking a Lead Product Manager to own the agent runtime and evaluation layer of Foundry, the platform for AI agents, apps, and code. It is built for non-engineers who can describe needs and receive governed automation with identity, access, and audit trails.

You will report to the Group Product Manager for Foundry and collaborate with a dedicated engineering team. About 75% of your time focuses on the agent runtime—versions, deployments, evaluations, and handling model

Responsibilities

• Build the agent runtime for non-engineers: define the vision, strategy, and roadmap for a platform where business users take an agent, app, or script from idea to governed production without an engineering cycle.
• Own evaluations and model governance: define testing, golden datasets, labeling and regression gates; decide when models are eligible for agents and when human oversight is needed.
• Address the 'who evaluates the evaluator' challenge: ensure checks for agents that grade other agents, partnering with engineering on robust patterns.

Job description

Juniper Square is seeking a Lead Product Manager to own the agent runtime and evaluation layer of Foundry, the platform for AI agents, apps, and code. It is built for non-engineers who can describe needs and receive governed automation with identity, access, and audit trails.

You will report to the Group Product Manager for Foundry and collaborate with a dedicated engineering team. About 75% of your time focuses on the agent runtime—versions, deployments, evaluations, and handling model