Remote AI Safety Evaluator & Red Team Specialist

mercor; United States; Remote; USD 10,000 - 17,000; Part time

Job summary

Mercor is seeking an AI Safety Specialist to evaluate the accuracy of AI-generated content and strengthen model rigor. This remote, contract role requires self-directed work and timely feedback to AI research teams for improved safety standards.

Responsibilities include developing rubrics, benchmarks, and internal reviews to ensure safe, reliable outputs. Ideal candidates have strong English writing, cybersecurity or adversarial testing experience, and the ability to work under tight deadlines

Qualifications

• Strong written English and attention to detail.
• Experience in AI safety, red teaming, cybersecurity, or adversarial testing.
• Ability to work independently under tight deadlines.

Responsibilities

• Evaluate the accuracy and depth of AI-generated content in AI safety to strengthen reasoning and rigor in model outputs.
• Review complex cybersecurity content for alignment with domain principles and methodologies.
• Provide clear, structured feedback to AI research teams to improve training data quality and downstream performance.
• Develop evaluation rubrics and benchmarks for assessing AI-generated safety tasks and solutions.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Strong written English

Attention to detail

AI safety

Red teaming

Cybersecurity

Trust and safety

Content moderation

Policy evaluation

Adversarial testing

Job description

Mercor is seeking an AI Safety Specialist to evaluate the accuracy of AI-generated content and strengthen model rigor. This remote, contract role requires self-directed work and timely feedback to AI research teams for improved safety standards.

Responsibilities include developing rubrics, benchmarks, and internal reviews to ensure safe, reliable outputs. Ideal candidates have strong English writing, cybersecurity or adversarial testing experience, and the ability to work under tight deadlines