Politics AI Evaluation Specialist

Turing

United States

Remote

USD 83,000 - 124,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Contractor assignment
8 weeks duration
PST overlap

Job summary

Turing is seeking a Politics Domain Expert to design prompts, assess factual accuracy, and identify gaps in political knowledge within LLMs. You will craft challenging tasks in politics, governance, elections, and international relations, and provide evidence-backed feedback to improve model performance.

The contractor role requires 40 hours per week with PST overlap, is 8 weeks long, and involves working with a team of AI researchers to ensure high-quality evaluations and thorough documentation.

Qualifications

  • Master's degree or higher in political science, public policy, international relations, or a related field.
  • Strong knowledge of politics, governance, elections, public policy, international relations, and political institutions.
  • 3+ years of relevant professional experience in public policy, government, political research, or related fields.
  • Excellent written English, research, and analytical skills.

Responsibilities

  • Create advanced prompts covering political science, governance, elections, public policy, and international relations.
  • Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
  • Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
  • Develop benchmark datasets and adversarial test cases.
  • Provide evidence-based feedback with reliable references.
  • Collaborate with AI researchers to improve model performance.
  • Maintain high annotation quality and documentation.

Skills

Political knowledge
Analytical skills
Excellent written English
Attention to detail

Education

Master's degree+

Job description

Turing is seeking a Politics Domain Expert to design prompts, assess factual accuracy, and identify gaps in political knowledge within LLMs. You will craft challenging tasks in politics, governance, elections, and international relations, and provide evidence-backed feedback to improve model performance.

The contractor role requires 40 hours per week with PST overlap, is 8 weeks long, and involves working with a team of AI researchers to ensure high-quality evaluations and thorough documentation.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Domain Expert- Politics
Domain Expert- Politics

Turing • United States

Remote
USD 83,000 - 124,000
Contractor assignment
8 weeks duration
PST overlap
LLM Evaluation Domain Expert · Turing Turing · Varies · remote · 4w ago Varies 4w ago
LLM Evaluation Domain Expert · Turing Turing · Varies · remote · 4w ago Varies 4w ago

Benture • San Francisco (CA)

Hybrid
USD 90,000 - 150,000
LLM Evaluation & Prompt Testing Engineer
LLM Evaluation & Prompt Testing Engineer

HumanitApp • San Francisco (CA)

On-site
USD 120,000 - 180,000
Tooling Engineer
Tooling Engineer

Turing • United States

Remote
USD 120,000 - 150,000
Senior Policy & Strategy SME — AI Evaluation
Senior Policy & Strategy SME — AI Evaluation

Turing • United States

Remote
USD 83,000 - 138,000
Politics & Government Specialist – Freelance AI Trainer Project
Politics & Government Specialist – Freelance AI Trainer Project

Meridial • United States

Remote
USD 8,265 - 89,544
Flexible work hours
Remote work
Politics & Government Specialist – Freelance AI Trainer Project
Politics & Government Specialist – Freelance AI Trainer Project

Agency • United States

Remote
USD 8,300 - 90,000
Political Scientists / Policy Analysts — Senior Expert
Political Scientists / Policy Analysts — Senior Expert

Turing • United States

Remote
USD 83,000 - 138,000
Domain Expert - Art
Domain Expert - Art

Turing • United States

Remote
USD 55,000 - 110,000
Contractor assignment
8 weeks duration
Politics & Government Specialist
Politics & Government Specialist

Agency • United States

Remote
USD 85,000 - 120,000