AI Safety Evaluation Specialist – Remote

Visa Hunt; Denmark; On-site; DKK 533,000 - 621,000; Full time

Job summary

Mercor is seeking an AI Safety Practitioner for remote engagement. This contract role involves evaluating AI-generated content for safety, accuracy, and policy compliance, covering misinformation, political content, and biosecurity risks.

The candidate should have a strong background in AI safety, journalism, or public policy with a minimum of a bachelor’s degree and at least five years of relevant experience. Collaboration with AI researchers and safety teams is expected.

Qualifications

• Must have excellent written English, critical thinking, and analytical reasoning.
• 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, or related field.
• Ability to evaluate nuanced and policy-sensitive scenarios consistently.

Responsibilities

• Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and quality.
• Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with AI researchers and safety teams on evaluation initiatives.

Skills

English proficiency

Critical thinking

Analytical reasoning

5+ years AI Safety

Education

Bachelor's degree or higher

Job description

Mercor is seeking an AI Safety Practitioner for remote engagement. This contract role involves evaluating AI-generated content for safety, accuracy, and policy compliance, covering misinformation, political content, and biosecurity risks.

The candidate should have a strong background in AI safety, journalism, or public policy with a minimum of a bachelor’s degree and at least five years of relevant experience. Collaboration with AI researchers and safety teams is expected.