Senior AI Trainer - Remote Data Evaluation Pro

RemoteJobsOne; Manila; Remote; PHP 12,077,000 - 12,078,000; Full time

Job summary

RemoteJobsOne is seeking a Senior AI Trainer contractor to collaborate on a customer-driven project enhancing AI system quality through expert-level model training and evaluation. You will apply hands-on experience with AI products to help train next-generation models.

Responsibilities include evaluating AI chat and search tool performance, writing prompts, grading with rubrics, and collaborating with trainers to align guidelines.

Qualifications

• Exceptional attention to detail and accuracy in reviewing and evaluating AI-generated content.
• Strong written and verbal communication skills for effective collaboration, reporting, and timely updates on progress and challenges.
• Demonstrated time management and self-organization abilities for independent, remote project participation.
• Analytical and problem-solving mindset, with a proactive approach to resolving evaluation challenges.

Responsibilities

• Evaluate the performance of AI chat and search tools under standardized, repeatable conditions.
• Apply detailed grading guidelines to accurately evaluate, rank, and annotate model responses, providing structured feedback that improves model performance.
• Write, refine, and stress-test prompts that probe model capabilities, ensuring coverage of diverse scenarios, edge cases, and user intents.
• Verify consistency and accuracy across evaluations, correcting discrepancies between ratings and the underlying rubric or guidelines.
• Utilize AI training tools and platforms to record findings and submit evaluation datasets in alignment with project standards and milestones.
• Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
• Participate in ongoing quality reviews, incorporating feedback to maintain rigorous training and annotation standards.

Skills

Attention to detail

Communication

Time management

Analytical mindset

Job description

RemoteJobsOne is seeking a Senior AI Trainer contractor to collaborate on a customer-driven project enhancing AI system quality through expert-level model training and evaluation. You will apply hands-on experience with AI products to help train next-generation models.

Responsibilities include evaluating AI chat and search tool performance, writing prompts, grading with rubrics, and collaborating with trainers to align guidelines.