AI Evaluation Programs Lead (Remote-friendly)

CLERA; San Francisco (CA); On-site; USD 130,000 - 225,000; Full time

Benefits offered by this job

Visa sponsorship

Relocation assistance

Competitive salary

Job summary

Clera Labs, Inc. is seeking a Technical Program Manager to own complex data and evaluation programs for AI research teams and internal partners. You will align scope, requirements, and milestones across data ops and vendor coordination to ensure high-quality evaluation data.

You will translate ambiguous requests into actionable plans, manage external vendors, and drive data quality with metrics, while collaborating with research, platform, and marketplace teams to ship improvements.

Qualifications

• 3+ years owning complex technical programs in AI/ML, data ops, or related cross-functional field.
• Startup TPM/Strategic Program Lead experience in fast-paced environments.
• Experience translating ambiguous tech requirements into executable plans and data quality processes.
• Strong judgment evaluating datasets; balance aggregate metrics and individual examples.
• Vendor management and scaling delivery pipelines for AI research teams.

Responsibilities

• Lead data and evaluation programs from scoping to production and retrospective.
• Turn ambiguous requests into clear specifications with milestones and owners.
• Assess and improve data quality using quantitative metrics and qualitative review.
• Manage external vendors throughout the delivery lifecycle and improve pipelines.
• Improve workflows, documentation, automation, and cross-functional handoffs for data production.
• Partner with research, platform, and marketplace teams to turn feedback into product improvements.

Skills

Technical program management

AI/ML data operations

Vendor coordination

Requirements decomposition

Data quality assessment

Cross-functional collaboration

Tools

RLHF

Reinforcement-learning environments

Job description

Clera Labs, Inc. is seeking a Technical Program Manager to own complex data and evaluation programs for AI research teams and internal partners. You will align scope, requirements, and milestones across data ops and vendor coordination to ensure high-quality evaluation data.

You will translate ambiguous requests into actionable plans, manage external vendors, and drive data quality with metrics, while collaborating with research, platform, and marketplace teams to ship improvements.