AI Safety Annotation Lead - Remote & Flexible Hours

Turing; United States; Remote; USD 90,000 - 130,000; Full time

Benefits offered by this job

Flexible working hours

Remote work environment

Competitive compensation

Job summary

Turing, a US-based AI services company, seeks a Team Lead to guide a group of business analysts focused on evaluating AI outputs for accuracy and policy compliance. The role emphasizes leadership, policy-driven quality assurance, and timely feedback to improve annotation reliability.

Ideal candidates will have strong attention to detail, the ability to apply complex policies, and excellent written English. This remote role offers flexible hours and a fast-paced, high-stakes environment.

Qualifications

• Strong attention to detail and analytical reasoning.
• Experience identifying systematic errors in annotations or evaluations.
• Ability to apply detailed policy guidelines consistently.
• Native-level English fluency with strong written communication.

Responsibilities

• Audit trainer-submitted evaluations for policy misapplication, incomplete reasoning, scoring drift, schema errors, and annotation inconsistencies.
• Apply a detailed AI safety policy framework consistently across high-stakes review tasks.
• Identify individual and systematic errors in human-generated annotations and written assessments.
• Validate annotation completeness, scoring accuracy, policy alignment, and adherence to required schemas.
• Provide direct, constructive feedback to trainers and recommend corrective actions when quality issues are identified.
• Document recurring error patterns and contribute to quality improvement, calibration, and reviewer training initiatives.
• Maintain accuracy and consistency while working under time-sensitive conditions and handling sensitive content.

Skills

Attention to detail

Analytical reasoning

Policy guidelines

English fluency

Feedback delivery

Independent work

Time management

Job description

Turing, a US-based AI services company, seeks a Team Lead to guide a group of business analysts focused on evaluating AI outputs for accuracy and policy compliance. The role emphasizes leadership, policy-driven quality assurance, and timely feedback to improve annotation reliability.

Ideal candidates will have strong attention to detail, the ability to apply complex policies, and excellent written English. This remote role offers flexible hours and a fast-paced, high-stakes environment.