Technical Program Manager, AI Data & Evaluation (Remote)

Clera

Oregon

Hybrid

USD 130,000 - 225,000

Full time

10 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Clera seeks a Technical Program Manager to lead complex data and evaluation programs for AI research teams. You will scope requirements, coordinate cross-functional teams, and ensure high-quality data for LLM and agent evaluation.

You will collaborate with research, platform, and marketplace teams, manage external vendors, and drive production pipelines, balancing speed and quality in a fast-paced startup environment.

Qualifications

  • 3+ years owning complex technical programs in AI/ML or data operations.
  • Experience as a Technical Program Manager at a startup translating ambiguity into executable plans.
  • Strong quantitative and qualitative judgment for dataset quality.
  • Experience improving data quality procedures and scaling delivery pipelines.
  • Background supporting AI research teams with urgent, changing requirements.

Responsibilities

  • Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
  • Turn ambiguous technical requests into specifications with clear milestones, owners, dependencies, and acceptance criteria.
  • Improve data quality processes using quantitative signals and qualitative review, including task coverage, difficulty, and reward distributions.
  • Manage external vendors throughout delivery and scale reliable production pipelines.
  • Improve workflows, documentation, automation, and cross-functional handoffs for data production and evaluation.
  • Work with research, platform, and marketplace teams to turn findings into product improvements.

Skills

Program ownership
Technical PM experience
Vendor management
Data quality assessment
Workflow automation

Job description

Clera seeks a Technical Program Manager to lead complex data and evaluation programs for AI research teams. You will scope requirements, coordinate cross-functional teams, and ensure high-quality data for LLM and agent evaluation.

You will collaborate with research, platform, and marketplace teams, manage external vendors, and drive production pipelines, balancing speed and quality in a fast-paced startup environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Evaluation Programs Lead (Remote-friendly)
AI Evaluation Programs Lead (Remote-friendly)

CLERA • San Francisco (CA)

On-site
USD 130,000 - 225,000
Visa sponsorship
Relocation assistance
Competitive salary
Technical Program Manager
Technical Program Manager

Clera • Oregon

Hybrid
USD 130,000 - 225,000
Applied AI Project Lead: Multilingual Data & LLM Evaluation
Applied AI Project Lead: Multilingual Data & LLM Evaluation

LILT AI • United States

On-site
USD 110,000 - 180,000
Remote AI Infrastructure & Product Engineer
Remote AI Infrastructure & Product Engineer

Aitomic Jobs • United States

Remote
USD 180,000 - 260,000
Remote within the United States
Senior AI Engineer - Evaluation & LLM Platform (Remote)
Senior AI Engineer - Evaluation & LLM Platform (Remote)

Showcify, Inc. • United States

Remote
USD 180,000 - 260,000
Technical Program Manager
Technical Program Manager

CLERA • San Francisco (CA)

On-site
USD 130,000 - 225,000
Visa sponsorship
Relocation assistance
Competitive salary
Founding AI Agent Runtime Engineer - Remote (Equity)
Founding AI Agent Runtime Engineer - Remote (Equity)

Clera Labs, Inc. • United States

Remote
USD 120,000 - 180,000
Founding equity
Senior Technical Program Manager / Strategic Program Lead AI
Senior Technical Program Manager / Strategic Program Lead AI

1752vc • New York (NY)

On-site
USD 140,000 - 210,000
Senior Platform Engineer: AI/ML Backend & Data Pipelines (Remote)
Senior Platform Engineer: AI/ML Backend & Data Pipelines (Remote)

Clera • Oregon

Hybrid
USD 160,000 - 250,000
Applied AI Project Manager: Data Pipelines & LLM Eval
Applied AI Project Manager: Data Pipelines & LLM Eval

Lilt---Lega-Italiana-Per-La-Lotta-Contro-I-Tumori-1 • United States

On-site
USD 140,000 - 210,000