Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
AI Trainer HQ is seeking independent contractors to design evaluation prompts, rubrics, and benchmark data for an AI benchmark project. The work is remote in the United States and focuses on information science, data management, and knowledge organization.
You will craft realistic tasks, develop scoring rubrics, and generate high-quality data for model training. This contract is 100% remote; benefits do not apply.
Project Overview
We are sourcing independent Information Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly generate professional-grade data management strategies, information retrieval systems, and content architecture deliverables, their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks, strong prompts, and clear, well-structured rubrics that generate clean, reliable data for model training.
Project Deliverables & Scope
Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:
Required Expertise
To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios.
We offer a pay range of $10-to-$30 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.
Engagement Type: Freelance / Independent Contractor
Workplace Type: Remote
This job is 100% remote.
Open only to people in United States.
Strong writing and prompt generation skills, with the ability to design highly realistic, complex information retrieval task scenarios for AI evaluation; Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation; A meticulous, detail-oriented approach to fact-checking data architectures, search mechanics, and knowledge bases to generate reliable data for system benchmarking