Senior AI Trainer – Remote Evaluation & Prompting Expert

Zekai; United States; Remote; USD 110,000 - 165,000; Full time

Job summary

Zekai is seeking a Senior AI Trainer for a 100% remote contract role. You will collaborate on customer-driven projects to enhance AI system quality through expert-level model training and evaluation.

Responsibilities include evaluating AI responses, developing prompts, and ensuring consistency with rubrics while working with project trainers remotely. The ideal candidate demonstrates exceptional attention to detail, strong communication, and experience with AI product training.

Qualifications

• High attention to detail when evaluating AI outputs.
• Strong written and verbal communication for feedback and reporting.
• Proven time management for independent, remote work.
• Analytical mindset with problem-solving in evaluation tasks.
• Familiarity with RLHF data labeling and model evaluation.

Responsibilities

• Evaluate AI chat and search tool performance under standardized conditions.
• Apply grading rubrics to rank and annotate model responses.
• Write and stress-test prompts for diverse scenarios and intents.
• Verify consistency between ratings and rubrics, fix discrepancies.
• Record findings using training tools and submit evaluation data.

Skills

Attention to detail

Written communication

Verbal communication

Time management

Analytical thinking

Prompt engineering

RLHF data labeling

Remote collaboration

Tools

AI tooling

Job description

Zekai is seeking a Senior AI Trainer for a 100% remote contract role. You will collaborate on customer-driven projects to enhance AI system quality through expert-level model training and evaluation.

Responsibilities include evaluating AI responses, developing prompts, and ensuring consistency with rubrics while working with project trainers remotely. The ideal candidate demonstrates exceptional attention to detail, strong communication, and experience with AI product training.