AI Benchmarks & Evaluations Program Manager

Mercor; San Francisco (CA); On-site; USD 120,000 - 200,000; Full time

Benefits offered by this job

Performance bonus structure

Equity grant

$15K relocation bonus

$10K housing bonus

$1.5K monthly meals stipend

Free Equinox membership

$200 monthly laundry reimbursement

$200 monthly wellness reimbursement

Health, Dental, Vision insurance

401(k) with company match

Job summary

A leading AI development firm situated in San Francisco is looking for a Research Program Manager to coordinate the development and evaluation of AI benchmarks. You will collaborate across teams to ensure rigorous evaluation processes are upheld and results shared with the community. The ideal candidate should possess 2-3 years of experience in consulting or tech, strong analytical skills, and enjoy process optimization. The position offers a competitive salary and generous perks, including relocation and housing bonuses.

Qualifications

• 2-3 years of professional experience in consulting, tech, or research support.
• Strong analytical and communication abilities.
• Ability to manage complex projects.

Responsibilities

• Coordinate the release of new benchmarks.
• Maintain and update leaderboards and website.
• Submit results to competitions and community pages.
• Run and monitor new evaluations.
• Support marketing for benchmarks and evaluations.
• Develop messaging for benchmark releases.
• Coordinate delivery of evaluation reports.
• Build relationships in the AI evaluations ecosystem.

Skills

Analytical abilities

Communication abilities

Project management

Problem-solving

Job description

A leading AI development firm situated in San Francisco is looking for a Research Program Manager to coordinate the development and evaluation of AI benchmarks. You will collaborate across teams to ensure rigorous evaluation processes are upheld and results shared with the community. The ideal candidate should possess 2-3 years of experience in consulting or tech, strong analytical skills, and enjoy process optimization. The position offers a competitive salary and generous perks, including relocation and housing bonuses.