Remote Lead AI Trainer & Prompt Evaluator

Feitong Buke; United States; Remote; USD 75,000 - 100,000; Full time

Benefits offered by this job

28 vacation days per year

7 wellness days per year

Bonuses up to $5000 for referrals

50% payment for professional training

Health benefits up to $1,000 per year

Workplace organization reimbursement

Internal gamified gratitude system

Job summary

Feitong Buke is hiring a Lead AI Trainer to oversee and enhance the quality of AI model dialogues with users. The role involves reviewing datasets for accuracy, providing feedback to annotators, and validating AI model outputs to ensure high production quality.

Candidates should have experience in annotation for conversational AI and a keen ability to analyze conversational responses. This is a remote full-time position offering substantial benefits, including health compensation and workplace organization support.

Qualifications

• Experience in dataset annotation and content validation for conversational AI/chat models/NLP products.
• Ability to analyze accuracy, tone, safety, and contextual relevance issues.
• Strong attention to detail and ability to consistently apply evaluation criteria.

Responsibilities

• Review and assess the quality of datasets produced by the content team.
• Provide feedback and maintain a high quality bar across annotators.
• Validate conversational AI model outputs to detect issues.

Skills

Experience in dataset annotation

Hands-on experience with model evaluation frameworks

Ability to analyze conversational responses

Strong attention to detail

Familiarity with prompt engineering practices

English proficiency (B2+) in reading and writing

Job description

Feitong Buke is hiring a Lead AI Trainer to oversee and enhance the quality of AI model dialogues with users. The role involves reviewing datasets for accuracy, providing feedback to annotators, and validating AI model outputs to ensure high production quality.

Candidates should have experience in annotation for conversational AI and a keen ability to analyze conversational responses. This is a remote full-time position offering substantial benefits, including health compensation and workplace organization support.