AI Task Architect — Materials Science & Engineering

Mercor; New York (NY); Remote; USD 120,000 - 180,000; Full time

Job summary

Mercor is seeking a senior contributor to craft domain-authentic AI evaluation tasks in materials science, electrical, or mechanical engineering. You will author realistic prompts, assemble data rooms, and define objective grading to distinguish expert reasoning from model performance.

You will collaborate with project leads and domain experts to establish what constitutes quality work and how to measure it effectively in evolving tasks.

Qualifications

• Senior expertise in materials science or related fields.
• Experience with metals, ceramics, composites, or characterization.
• Ability to explain why a wrong answer is wrong, not just the correct answer.

Responsibilities

• Author domain-authentic tasks drawn from your prior work.
• Build the data room and grading criteria for objective scoring.
• Run tasks against models, analyze successes and failures, iterate to sharpen discrimination.
• Collaborate with project lead and domain experts to define what 'good' looks like in the domain.

Skills

Materials science expertise

Electrical engineering

Mechanical engineering

Job description

Mercor is seeking a senior contributor to craft domain-authentic AI evaluation tasks in materials science, electrical, or mechanical engineering. You will author realistic prompts, assemble data rooms, and define objective grading to distinguish expert reasoning from model performance.

You will collaborate with project leads and domain experts to establish what constitutes quality work and how to measure it effectively in evolving tasks.