Ai Safety Evaluator - Remote, High-Impact Model Quality

Mercor; Lisboa; Remote; EUR 60,000 - 85,000; Full time

Job summary

Mercor is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, accuracy, and policy compliance, review content across sensitive domains, refine RLHF and SFT rubrics, and identify unsafe outputs and reasoning failures.

A Bachelor's degree or higher and 5+ years in AI safety are required, with excellent written English and analytical skills. Remote role with international scope, based in Lisbon, Portugal.

Qualifications

• Bachelor's degree or higher in a relevant field.
• 5+ years in AI safety or related fields.
• Excellent written English and analytical skills.

Responsibilities

• Evaluate AI-generated responses for safety, accuracy and policy compliance.
• Review content across sensitive domains.
• Refine RLHF and SFT rubrics.
• Identify unsafe outputs and reasoning failures.

Skills

Written English

Analytical thinking

Education

Bachelor's degree

Job description

Mercor, a global talent network for AI research, is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, accuracy, and policy compliance. Responsibilities include reviewing content across sensitive domains, refining RLHF and SFT rubrics, and identifying unsafe outputs and reasoning failures. You should have a Bachelor's degree or higher and 5+ years in AI safety or related fields, with excellent written English and analytical skills.

Ai Safety Evaluator - Remote, High-Impact Model Quality Lisbon, Portuguese Republic, PT