Remote Information Specialist: AI Evaluation & Benchmarking

agency; Stati Uniti; Remoto; USD 14.000 - 41.000; Tempo pieno

Descrizione del lavoro

agency is seeking an experienced information science professional to create expert evaluation materials for AI information management systems. You will design tasks, prompts, and scoring guides, then verify that the resulting data reflects professional information practices.

This freelance remote role requires strong writing, rubric development, and attention to governance standards; you’ll produce benchmarks, ensure accuracy of metadata, search approaches, and knowledge-base details.

Competenze

• Professional expertise in information science or a related field.
• Familiarity with metadata schemas and search methodologies.
• Strong writing and rubric-development skills.
• Experience creating clear evaluation criteria.
• Attention to detail and careful fact-checking.

Mansioni

• Design complex, realistic prompts involving information science, data management, knowledge organization, or information retrieval.
• Build evaluation rubrics with specific, objective criteria that can be scored consistently.
• Produce structured benchmark and training examples for assessing AI-generated information architecture and retrieval work.
• Fact-check tasks and scoring criteria against data governance standards, research methods, and information management practices.
• Review metadata, search approaches, data architectures, and knowledge-base details for accuracy.

Conoscenze

Information science

Library science

Data governance

Knowledge management

Descrizione del lavoro

agency is seeking an experienced information science professional to create expert evaluation materials for AI information management systems. You will design tasks, prompts, and scoring guides, then verify that the resulting data reflects professional information practices.

This freelance remote role requires strong writing, rubric development, and attention to governance standards; you’ll produce benchmarks, ensure accuracy of metadata, search approaches, and knowledge-base details.