Chemistry AI Red-Team & Prompt Evaluation Expert

Obsidian; Washington (District of Columbia); On-site; USD 120,000 - 160,000; Full time

Job summary

Mercor is assembling a panel of chemistry domain experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request; answering legitimate questions fully while refusing genuinely dangerous ones.

You will write prompts across three levels, evaluate model responses, and craft the reference answers with clear technical reasoning for non-specialists to follow.

Qualifications

• Hands-on experience in synthesis, analytical chemistry, or chemical safety.
• Prior AI evaluation or red-teaming experience preferred.
• Willingness to write clear rationales for judgments.

Responsibilities

• Write challenging prompts across benign, dual-use, and adversarial levels.
• Evaluate model responses against a defined policy standard.
• Draft reference answers with technical reasoning.

Skills

Chemistry synthesis

Analytical chemistry

Chemical safety

Technical writing

Education

Bachelor's degree in Chemistry

Job description

Mercor is assembling a panel of chemistry domain experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request; answering legitimate questions fully while refusing genuinely dangerous ones.

You will write prompts across three levels, evaluate model responses, and craft the reference answers with clear technical reasoning for non-specialists to follow.