Remote Expert Prompt Curator for AI Evaluation Dataset

CloudDevs; United States; Remote; USD 69,000 - 124,000; Part time

Benefits offered by this job

Competitive hourly compensation

Set your own hours

Contribution to AI research

Job summary

A leading AI research firm is seeking Expert Prompt Curators to design challenging prompts for evaluating advanced AI models. The role requires advanced knowledge in diverse fields and offers flexible hours, remote work, and a competitive hourly wage. Ideal candidates will have experience in research and test question design. This is a short-term project with potential for extension, contributing to high-impact AI safety research.

Qualifications

• Advanced academic or professional expertise in a specialized subject.
• Strong ability to design precise, high-difficulty questions.
• Experience in academic research, benchmarking, or test question design preferred.
• Attention to detail and concise reasoning explanations.
• Familiarity with AI models and their limitations is a plus.

Responsibilities

• Create original, expert-level prompts that require tool use.
• Test prompts against advanced AI models and document results.
• Provide reasoning steps and solutions for each prompt.
• Collaborate with reviewers for expert validation and refinement.

Skills

Expertise in specialized subjects

Ability to design high-difficulty questions

Attention to detail

Familiarity with AI models

Education

Advanced academic or professional expertise

Job description

A leading AI research firm is seeking Expert Prompt Curators to design challenging prompts for evaluating advanced AI models. The role requires advanced knowledge in diverse fields and offers flexible hours, remote work, and a competitive hourly wage. Ideal candidates will have experience in research and test question design. This is a short-term project with potential for extension, contributing to high-impact AI safety research.