AI Data & Evaluation Program Manager

CLERA

San Francisco (CA)

On-site

USD 130,000 - 225,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Visa sponsorship

Job summary

Clera Labs, Inc. is seeking a Senior Technical Program Manager to own complex data and evaluation programs for AI research teams and internal partners.

You will drive scoping, production, QA, and retrospectives while turning ambiguous requests into reliable programs that improve LLM and agent evaluation. The role emphasizes cross-functional leadership, data quality, vendor management, and scalable delivery pipelines, with strong emphasis on independent work in a fast-paced environment.

Qualifications

  • Minimum of 3 years owning complex technical programs in AI/ML, data ops, or related cross-functional fields.
  • Experience as a TPM or strategic program lead at a startup with ability to bring structure to changing requirements.
  • Strong quantitative and qualitative judgment to assess dataset metrics and individual examples.
  • Experience improving data quality procedures, managing external vendors, and supporting technical customers or research teams with urgent needs.
  • Background in RLHF, reinforcement-learning environments, agent evaluations, or related data pipelines is valuable.
  • Excellent communication skills and ability to work independently in a fast-paced environment.

Responsibilities

  • Lead data and evaluation programs from scoping to production, QA, delivery, and retrospectives.
  • Turn ambiguous technical requests into clear specs with milestones, owners, dependencies, and acceptance criteria.
  • Improve data quality processes using quantitative measures and qualitative review, including task coverage, difficulty, and reward distributions.
  • Manage external vendors through the delivery lifecycle and strengthen scalable delivery pipelines.
  • Improve workflows, documentation, automation, and cross-functional handoffs for data production and evaluation.
  • Partner with research, platform, and marketplace teams to turn findings into product improvements.

Skills

Technical Program Management
Data Operations
Vendor Coordination
Cross-functional Leadership
RLHF Experience
Analytical Thinking

Job description

Clera Labs, Inc. is seeking a Senior Technical Program Manager to own complex data and evaluation programs for AI research teams and internal partners.

You will drive scoping, production, QA, and retrospectives while turning ambiguous requests into reliable programs that improve LLM and agent evaluation. The role emphasizes cross-functional leadership, data quality, vendor management, and scalable delivery pipelines, with strong emphasis on independent work in a fast-paced environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Applied AI Program Manager - Data Ops & Evaluation
Applied AI Program Manager - Data Ops & Evaluation

lilt-corporate • United States

Remote
USD 140,000 - 210,000
AI Data & Evaluation Program Lead
AI Data & Evaluation Program Lead

HUD • San Francisco (CA)

Hybrid
USD 150,000 - 230,000
Medical/dental/vision covered
Office meals
Holiday break
+4
Applied AI Project Manager: Data Pipelines & LLM Eval
Applied AI Project Manager: Data Pipelines & LLM Eval

Lilt---Lega-Italiana-Per-La-Lotta-Contro-I-Tumori-1 • United States

On-site
USD 140,000 - 210,000
Technical Program Manager
Technical Program Manager

CLERA • San Francisco (CA)

On-site
USD 130,000 - 225,000
Visa sponsorship
Applied AI Project Lead: Multilingual Data & LLM Evaluation
Applied AI Project Lead: Multilingual Data & LLM Evaluation

LILT AI • United States

On-site
USD 110,000 - 180,000
Technical Project Manager
Technical Project Manager

lilt-corporate • United States

Remote
USD 140,000 - 210,000
Senior RL Environment Architect for AI Evaluation (Remote)
Senior RL Environment Architect for AI Evaluation (Remote)

Clera Labs, Inc. • United States

Remote
USD 110,000 - 276,000
Senior Technical Program Manager / Strategic Program Lead AI
Senior Technical Program Manager / Strategic Program Lead AI

1752vc • New York (NY)

On-site
USD 140,000 - 210,000
Remote Senior AI Evaluation Engineer
Remote Senior AI Evaluation Engineer

LTM • Irving (TX)

Remote
USD 120,000 - 180,000
Term and Long-Term Disability Coverage
Plan with Company match.
Paternity and Maternity Leave
Senior Specialist / Manager, AI Safety Data and Evaluation Program
Senior Specialist / Manager, AI Safety Data and Evaluation Program

Lila Sciences • Cambridge (MA), San Francisco (CA)

On-site
USD 120,000 - 170,000