AI Safety Evaluation Specialist — Remote Contract

mercor; Polska; Teletrabalho; PLN 323 000 - 377 000; Tempo parcial

Resumo da oferta

Mercor connects elite creative and technical talent with leading AI research labs. A remote, contract position as AI Safety Practitioner involves evaluating AI outputs for safety, accuracy, and policy compliance.

You will review high-risk content and work with researchers to improve model alignment. Ideal candidates have a strong background in AI safety, policy, or related fields and excellent written English.

Qualificações

• Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or related discipline.
• 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or related field.
• Excellent written English, critical thinking, and analytical reasoning skills.
• Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Responsabilidades

• Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
• Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
• Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
• Provide structured feedback to improve model alignment and safety performance.
• Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Conhecimentos

AI Safety

Policy evaluation

Critical thinking

Written English

Formação académica

Bachelor's degree or higher in a related discipline

Descrição da oferta de emprego

Mercor connects elite creative and technical talent with leading AI research labs. A remote, contract position as AI Safety Practitioner involves evaluating AI outputs for safety, accuracy, and policy compliance.

You will review high-risk content and work with researchers to improve model alignment. Ideal candidates have a strong background in AI safety, policy, or related fields and excellent written English.