Remote AI Policy & Prompt Evaluation Specialist (Contract)

Crossing Hurdles; Turkey; On-site; TRY 26,391,000 - 52,782,000; Full time

Job summary

Crossing Hurdles is seeking a remote, short-term contractor to craft politics-related prompts for AI training and evaluate responses for accuracy and depth. The role runs for 9 weeks with up to 40 hours weekly and a 4-hour overlap with PST.

Compensation is $20 per approved task, and candidates should have a Master’s in Politics with strong English writing and analytical skills. Prior AI evaluation experience is a plus.

Qualifications

• Strong years of professional, research, or teaching experience in Politics or related fields.
• Master's degree or higher in Politics or a related discipline.
• Strong knowledge of political science, governance, elections, public policy, and international relations.
• Excellent written English and strong analytical skills.
• Strong attention to detail and ability to provide objective, evidence-backed reviews.
• Experience with LLMs, Generative AI, prompt engineering, or AI evaluation is preferred.

Responsibilities

• Create advanced politics-related prompts for AI training and evaluation.
• Evaluate AI-generated responses for accuracy, reasoning, completeness, and nuance.
• Identify hallucinations, inconsistencies, outdated information, and knowledge gaps.
• Develop benchmark datasets and adversarial test cases.
• Provide evidence-based feedback with reliable references.
• Maintain high annotation quality and documentation.

Skills

Political science

Analytical skills

English writing

Attention to detail

AI evaluation

Education

Master's degree in Politics

Tools

LLMs

Generative AI

Prompt engineering

Job description

Crossing Hurdles is seeking a remote, short-term contractor to craft politics-related prompts for AI training and evaluate responses for accuracy and depth. The role runs for 9 weeks with up to 40 hours weekly and a 4-hour overlap with PST.

Compensation is $20 per approved task, and candidates should have a Master’s in Politics with strong English writing and analytical skills. Prior AI evaluation experience is a plus.