AI Safety Specialist - Fully Remote

Mercor; New York (NY); Remote; USD 21,000 - 34,000; Full time

Job summary

Mercor is seeking contributors to review short English-language conversations and evaluate how well AI responses address user requests. You will follow a set of guidelines to assess each conversation and submit structured feedback.

This is a remote, project-based role with training provided. Strong English reading comprehension and attention to detail are important, and prior annotation experience is a plus. You will work in flexible batches and report findings to the project team.

Qualifications

• Strong English reading comprehension.
• Good attention to detail and ability to follow written instructions.
• Prior review or annotation experience is helpful, but not required.

Responsibilities

• Read user prompts and AI responses.
• Apply the appropriate labels using the project guidelines.
• Work independently and carefully across assigned batches.

Skills

Strong English reading comprehension

Attention to detail

Ability to follow instructions

Job description

Project overview

Review short English-language conversations and evaluate how well AI responses address user requests. You’ll follow a set of written guidelines to assess each conversation and submit structured feedback.

What you’ll do

• Read user prompts and AI responses.
• Apply the appropriate labels using the project guidelines.
• Work independently and carefully across assigned batches.

Who should apply

• Strong English reading comprehension.
• Good attention to detail and ability to follow written instructions.
• Prior review or annotation experience is helpful, but not required.

This is remote, project-based work. Training and guidelines will be provided.