AI Trainer - Data Annotation Specialist (Safety)

Turing; United States; Remote; USD 21,000 - 34,000; Part time

Job summary

Turing is seeking Data Annotators to evaluate AI-generated responses for safety and policy compliance. This non-coding role requires strong English, excellent attention to detail, and the ability to write clear, concise evaluations.

You will review single-turn and multi-turn conversations, assign 1–5 ratings, and provide evidence-based justifications, focusing on self-harm, violence, abuse, and other sensitive topics. Project pays hourly and lasts 1–2 weeks with possible extension.

Qualifications

• Native-level English proficiency required.
• Excellent reading comprehension and close-reading skills.
• Ability to write clear, concise evaluations.
• Comfort with reviewing sensitive content.

Responsibilities

• Evaluate AI-generated responses against safety policies.
• Review conversations for safety, accuracy, and policy compliance.
• Assign 1–5 ratings based on criteria.
• Provide evidence-based justifications for each rating.

Skills

English proficiency

Attention to detail

Close-reading

Judgment

Job description

Evaluate AI responses for safety and policy compliance.

About Turing:

Turing is a leading AI company that accelerates the development of advanced AI systems. Turing works with frontier AI labs and global enterprises to improve AI capabilities in reasoning, safety, coding, tool use, multimodality, and real-world workflows.

Role Overview:

We are looking for Data Annotators to evaluate AI-generated responses against defined safety policies. This is a non-coding role for candidates with strong communication skills, native-level English proficiency, excellent attention to detail, close-reading ability, sound judgment, and the ability to write clear, concise evaluations.

Key Responsibilities:

• Evaluate AI-generated responses against defined safety policies and sub-policies.
• Review single-turn and multi-turn conversations for safety, accuracy, and policy compliance.
• Assign consistent 1–5 ratings based on established evaluation criteria.
• Write clear, concise, and evidence-based justifications for each rating.
• Identify subtle safety concerns involving self-harm, violence, abuse, and other sensitive topics.

Requirements:

• Strong interest in data annotation and AI evaluation with excellent English proficiency.
• Excellent reading comprehension and close-reading skills.
• Ability to write clear, concise, and objective evaluations.
• Excellent attention to detail and awareness of subtle nuances.
• Strong judgment and ability to follow detailed safety policies.
• Ability to work accurately under time constraints.
• Comfort with reviewing sensitive content involving self-harm, violence, and abuse.
• Familiarity with US-specific references, systems, and terminology.

Preferred Qualifications:

• Experience in data annotation, content moderation, or policy review.
• Background in trust and safety, AI training, or response evaluation is preferred.
• Experience in editorial review, proofreading, compliance, or quality assurance.
• Familiarity with structured rating systems and evaluation rubrics.
• Experience reviewing single-turn and multi-turn conversations.

Project Details:

• Project Pay - Hourly
• Estimated start date - 23 october (or nearby dates)
• Duration - 1-2 weeks (with potential chances of extension)

Skills: Analysis