AI Operations Evaluation Lead

Mercor; New York (NY); Remote; USD 75,000 - 120,000; Part time

Job summary

Mercor is hiring experienced General and Operations Managers to evaluate and improve cutting‑edge AI systems. You will assess AI‑generated operational content and workflows, drawing on real‑world expertise in directing multi‑department operations, staffing, financial oversight, and cross‑functional decision‑making.

Ideal candidates have 4+ years in GM/Ops roles, strong written English, and can commit 20+ hours per week.

Qualifications

• 4+ years of experience in General Manager, Operations Manager, Operations Director, or related role.
• Experience directing multi‑department or multi‑location operations, including budgeting and staffing.
• Ability to commit 20+ hours per week.
• Strong written English communication skills.

Responsibilities

• Evaluate AI‑generated operational plans, staff schedules, performance reviews, and other management artifacts for quality and accuracy.
• Compare AI‑generated responses head‑to‑head based on operational soundness, financial rigor, and cross‑department feasibility.
• Review budgeting, staffing, workflow coordination, and performance improvement scenarios and provide expert feedback.

Skills

4+ years experience

Multidepartment operations

Budgeting & staffing

Cross-functional decision making

Strong written English

Job description

Mercor is hiring experienced General and Operations Managers to evaluate and improve cutting‑edge AI systems. You will assess AI‑generated operational content and workflows, drawing on real‑world expertise in directing multi‑department operations, staffing, financial oversight, and cross‑functional decision‑making.

Ideal candidates have 4+ years in GM/Ops roles, strong written English, and can commit 20+ hours per week.