Information Specialist - Freelance AI Trainer Project

agency; United States; Remote; USD 14,000 - 41,000; Full time

Job summary

agency is seeking an experienced information science professional to create expert evaluation materials for AI information management systems. You will design tasks, prompts, and scoring guides, then verify that the resulting data reflects professional information practices.

This freelance remote role requires strong writing, rubric development, and attention to governance standards; you’ll produce benchmarks, ensure accuracy of metadata, search approaches, and knowledge-base details.

Qualifications

• Professional expertise in information science or a related field.
• Familiarity with metadata schemas and search methodologies.
• Strong writing and rubric-development skills.
• Experience creating clear evaluation criteria.
• Attention to detail and careful fact-checking.

Responsibilities

• Design complex, realistic prompts involving information science, data management, knowledge organization, or information retrieval.
• Build evaluation rubrics with specific, objective criteria that can be scored consistently.
• Produce structured benchmark and training examples for assessing AI-generated information architecture and retrieval work.
• Fact-check tasks and scoring criteria against data governance standards, research methods, and information management practices.
• Review metadata, search approaches, data architectures, and knowledge-base details for accuracy.

Skills

Information science

Library science

Data governance

Knowledge management

Job description

Role overview

Create expert evaluation material for AI systems working on information management and retrieval. You’ll independently develop realistic tasks, prompts, and scoring guidance, then check that the resulting data reflects professional information practices.

Responsibilities

• Design complex, realistic prompts involving information science, data management, knowledge organization, or information retrieval.
• Build evaluation rubrics with specific, objective criteria that can be scored consistently.
• Produce structured benchmark and training examples for assessing AI-generated information architecture and retrieval work.
• Fact-check tasks and scoring criteria against data governance standards, research methods, and information management practices.
• Review metadata, search approaches, data architectures, and knowledge-base details for accuracy.

Requirements

• Professional expertise in information science, library science, data governance, or knowledge management.
• Familiarity with relevant industry standards, metadata schemas, and search methodologies.
• Strong writing skills and the ability to create realistic, challenging evaluation scenarios.
• Experience developing clear rubrics that limit ambiguity and subjective scoring.
• Careful fact-checking and attention to detail.

Benefits and work setup

• Freelance, independent-contractor engagement; work is remote.
• Stated pay range is $10–$30 per hour, with the rate based on experience, expertise, and location; the final offer may differ from the range.
• Contractors provide a secure computer and high-speed internet. Health insurance and paid time off are not provided.