Staff Tech PM - AI Evaluation & Privacy‑Aware Product

Ladders; United States; Remote; USD 200,000 - 350,000; Full time

Benefits offered by this job

Unlimited AI token budget

Flexible vacation

Healthcare coverage

Vision coverage

Dental coverage

Daily meals and snacks

Job summary

Ladders is seeking a Staff Technical Product Manager, Evals to lead evaluation strategy for an AI-driven coding product. You will collaborate with engineering to translate goals into technical requirements and shape how user data is used safely to guide product decisions.

This cross-functional role emphasizes privacy-aware data practices, strong product judgment, and the ability to operate in a fast-moving AI environment while working remotely in the United States.

Qualifications

• 5+ years of product management with technical evals.
• Strong software development, system design, and API design knowledge.
• Experience creating and managing eval methodologies.
• Understanding of UX design and product sense.
• Familiarity with AI context and engineering best practices.

Responsibilities

• Drive development of AI coding agent to improve cost, speed, and accuracy.
• Manage offline and online eval sets for product performance.
• Use extensive user data to inform eval creation.
• Ensure customer data privacy through anonymization practices.
• Collaborate with engineering on complex implementation challenges.

Skills

Product management

Eval methodologies

API design

AI context

Privacy-aware data

Cross-functional leadership

TypeScript

React

Job description

Ladders is seeking a Staff Technical Product Manager, Evals to lead evaluation strategy for an AI-driven coding product. You will collaborate with engineering to translate goals into technical requirements and shape how user data is used safely to guide product decisions.

This cross-functional role emphasizes privacy-aware data practices, strong product judgment, and the ability to operate in a fast-moving AI environment while working remotely in the United States.