Senior AI Domain Expert — GenAI Benchmarks & Specs

Mercor; San Francisco (CA); Hybrid; USD 180,000 - 250,000; Full time

Job summary

Mercor is seeking a senior engineering and software domain expert to join a leading AI lab's research and program management teams. You will review engineering knowledge work tasks, write instruction specs and golden solutions, and help build benchmarks that demonstrate real model improvements.

This is a full-time, on-site hybrid role based in the Bay Area, California. You must reside in the Bay Area or relocate at your own cost; relocation assistance is not provided.

Qualifications

• Bachelor's degree or higher in computer science, software engineering, or a closely related engineering discipline.
• 4+ years of substantive professional engineering practice building and shipping production software.
• Genuine specialization in at least one engineering domain (e.g., distributed systems, ML systems, or QA).
• Senior/lead level with ownership of systems and design decisions.
• Hands-on experience with large language models in professional work.

Responsibilities

• Data QA and reviews of engineering knowledge work tasks and model outputs.
• Write instruction specs and golden solutions for engineering problems.
• Design benchmarks and domain-specific evaluation sets.
• Calibration with client researchers to maintain consistent standards.

Skills

Data QA

Instruction specs

Benchmarks design

Calibration

Distributed systems

Backend infrastructure

Machine learning systems

Quality and test engineering

AI fluency

Education

Bachelor's degree in CS or related

MS or PhD preferred

Job description

Mercor is seeking a senior engineering and software domain expert to join a leading AI lab's research and program management teams. You will review engineering knowledge work tasks, write instruction specs and golden solutions, and help build benchmarks that demonstrate real model improvements.

This is a full-time, on-site hybrid role based in the Bay Area, California. You must reside in the Bay Area or relocate at your own cost; relocation assistance is not provided.