Staff Product Manager: AI Evaluations for Cyber Ops

Twenty Technologies; Virginia; In loco; USD 140.000 - 190.000; Tempo pieno

Vantaggi offerti da questo lavoro

Health benefits

Parental leave

Flexible PTO

Retirement plan

Descrizione del lavoro

Twenty Technologies in Arlington, Virginia, is seeking a Staff Product Manager to shape evaluation capabilities for agentic AI systems. You will partner with AI and engineering teams to define how agent performance and product quality are measured and turned into actionable workflows.

The strongest candidates will have experience building or managing agentic systems and turning technical needs into clear product directions.

Competenze

• Experience building or managing agentic AI systems.
• Experience building evaluations for agents or the evaluation product.
• Ability to translate evaluation needs into product requirements.
• Ability to define meaningful measures of agent performance.
• Strong communication and collaboration in a technical environment.

Mansioni

• Own or support the product roadmap for agentic AI evaluations, translating goals into priorities.
• Collaborate with engineering and AI teams to understand evaluation needs and workflows.
• Define how agent performance and quality should be assessed with useful measures.
• Convert evaluation needs into clear product requirements and acceptance criteria.
• Operationalize evaluation workflows and success metrics for consistent assessment.
• Use results to identify gaps and inform product decisions over time.

Conoscenze

Agentic AI systems

Product management

AI

Metrics

Cross-functional collaboration

Descrizione del lavoro

Twenty Technologies in Arlington, Virginia, is seeking a Staff Product Manager to shape evaluation capabilities for agentic AI systems. You will partner with AI and engineering teams to define how agent performance and product quality are measured and turned into actionable workflows.

The strongest candidates will have experience building or managing agentic systems and turning technical needs into clear product directions.