Information Specialist - Freelance AI Trainer Project

Meridial

United States

Remote

USD 14,000 - 41,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AI Trainer HQ is seeking independent contractors to design evaluation prompts, rubrics, and benchmark data for an AI benchmark project. The work is remote in the United States and focuses on information science, data management, and knowledge organization.

You will craft realistic tasks, develop scoring rubrics, and generate high-quality data for model training. This contract is 100% remote; benefits do not apply.

Qualifications

  • Deep knowledge of information science, library science, data governance, or knowledge management.
  • Strong writing and prompt generation skills for realistic task scenarios.
  • Ability to craft objective, non-ambiguous scoring criteria.
  • Meticulous approach to fact-checking data architectures and knowledge bases.

Responsibilities

  • Design complex evaluation frameworks and structured training data.
  • Create realistic prompts and evaluation rubrics for AI benchmarking.
  • Generate clean, reliable training data for model evaluation and refinement.
  • Perform quality assurance and fact-checking to meet data governance standards.

Skills

Information science expertise
Prompt writing
Rubric design
Quality assurance

Job description

Project Overview

We are sourcing independent Information Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly generate professional-grade data management strategies, information retrieval systems, and content architecture deliverables, their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks, strong prompts, and clear, well-structured rubrics that generate clean, reliable data for model training.

Project Deliverables & Scope

Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:

  • Task & Prompt Creation: Generating realistic, high-quality prompts that compel the AI model to produce complex, professional-grade deliverables specific to information science, data management, and knowledge organization.
  • Rubric Development: Writing clear, well-structured evaluation rubrics with criteria that are highly specific, non-ambiguous, and easy to score.
  • Benchmark Evaluation Data Generation: Producing clean, reliable training data that directly aids in the evaluation and refinement of AI models handling complex information architecture and retrieval tasks.
  • Quality Assurance & Fact-Checking: Ensuring all generated tasks and scoring criteria reflect strict, real-world data governance standards, research methodologies, and information management best practices.

Required Expertise

To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios.

Core skillset includes:
  • Demonstrable professional expertise within the information science, library science, data governance, or knowledge management sectors, with a deep understanding of industry standards, metadata schemas, and search methodologies.
  • Strong writing and prompt generation skills, with the ability to design highly realistic, complex information retrieval task scenarios for AI evaluation.
  • Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation.
  • A meticulous, detail-oriented approach to fact-checking data architectures, search mechanics, and knowledge bases to generate reliable data for system benchmarking.

We offer a pay range of $10-to-$30 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.

Engagement Type: Freelance / Independent Contractor

Workplace Type: Remote

Requirements
  • Strong writing and prompt generation skills, with the ability to design highly realistic, complex information retrieval task scenarios for AI evaluation
  • Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation
  • A meticulous, detail-oriented approach to fact-checking data architectures, search mechanics, and knowledge bases to generate reliable data for system benchmarking
Languages
  • English

This job is 100% remote.

Open only to people in United States.

Strong writing and prompt generation skills, with the ability to design highly realistic, complex information retrieval task scenarios for AI evaluation; Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation; A meticulous, detail-oriented approach to fact-checking data architectures, search mechanics, and knowledge bases to generate reliable data for system benchmarking

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Information Specialist
Information Specialist

Meridial • United States

Remote
USD 14,000 - 41,000
Information Specialist - Freelance AI Trainer Project
Information Specialist - Freelance AI Trainer Project

Meridial • United States

Remote
USD 13,776 - 41,328
Remote Information Specialist: AI Evaluation & Training Prompts
Remote Information Specialist: AI Evaluation & Training Prompts

Meridial • United States

Remote
USD 13,776 - 41,328
Scientific and Technical Service Specialist - Freelance AI Trainer Project
Scientific and Technical Service Specialist - Freelance AI Trainer Project

Invisible Technologies Inc. • United States

Remote
USD 14,000 - 41,000
Information Specialist - Freelance AI Trainer Project
Information Specialist - Freelance AI Trainer Project

agency • United States

Remote
USD 14,000 - 41,000
Scientific and Technical Service Specialist - Freelance AI Trainer Project
Scientific and Technical Service Specialist - Freelance AI Trainer Project

Meridial • United States

Remote
USD 14,000 - 41,000
Scientific and Technical Service Specialist
Scientific and Technical Service Specialist

Meridial • United States

Remote
USD 14,000 - 41,000
Healthcare & Social Assistance Specialist - Freelance AI Trainer Project
Healthcare & Social Assistance Specialist - Freelance AI Trainer Project

Meridial • United States

Remote
USD 14,000 - 41,000
Remote work
Flexible hours
Remote Information Specialist: AI Evaluation & Benchmarking
Remote Information Specialist: AI Evaluation & Benchmarking

agency • United States

Remote
USD 14,000 - 41,000
Government Specialist
Government Specialist

Meridial • United States

Remote
USD 14,000 - 41,000