History Expert AI Evaluation

OpenTrain AI, Inc.; United States; Remoto; USD 69.000 - 138.000; Part-time

Descrizione del lavoro

OpenTrain AI, Inc. is seeking part-time remote contractors to create and assess historical evaluation material for AI models. You will design scenarios to test source criticism and historical methods, and prepare reference answers showing how evidence supports or limits interpretations.

You will also rate responses for accuracy and context while flagging distortions or anachronisms. The role requires an advanced history degree and at least two years of teaching, research, archival, or published

Competenze

• Advanced degree in history or closely related field; at least two years of teaching, research, archival, or published historical work.
• Deep knowledge of a historical period or region; ability to weigh conflicting sources and explain what the evidence supports.
• Helpful experience: a PhD with peer‑reviewed publications, archival research, public history work, or reading knowledge of relevant research languages.

Mansioni

• Create and assess historical evaluation material for AI models.
• Write scenarios that test source criticism, historical methods, and competing explanations for events.
• Prepare reference answers showing how evidence supports or limits an interpretation.
• Rate AI responses for factual accuracy, historical context, and awareness of different historical interpretations.
• Flag responses that distort evidence, invent causes, or project present-day assumptions onto the past.

Conoscenze

Deep knowledge of a historical period/

Experience with primary sources

Ability to weigh conflicting sources

Formazione

Advanced degree in history or closely related field

PhD with peer‑reviewed publications

Descrizione del lavoro

Create historical reasoning scenarios, write evidence-based reference answers, and rate AI responses for accuracy and use of sources. Remote contract work pays $50 to $100 per hour, with a 20+ hour weekly commitment.

Remote Hourly · $50–$100/hr

$50–$100/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Posted

Open in 95 countries

• Albania
• Algeria
• Antigua and Barbuda
• Armenia
• Australia
• Austria
• Bahamas
• Bahrain
• Belgium
• Benin
• Bhutan
• Bosnia and Herzegovina
• Botswana
• Brunei
• Bulgaria
• Canada
• Costa Rica
• Côte d’Ivoire
• Croatia
• Cyprus
• Czechia
• Denmark
• Ecuador
• El Salvador
• Estonia
• Ethiopia
• Finland
• France
• Gambia
• Germany
• Greece
• Guatemala
• Guyana
• Hong Kong
• Hungary
• Iceland
• India
• Indonesia
• Ireland
• Israel
• Italy
• Jamaica
• Jordan
• Kenya
• Kuwait
• Latvia
• Liechtenstein
• Lithuania
• Luxembourg
• Madagascar
• Malaysia
• Malta
• Mauritius
• Mexico
• Moldova
• Mongolia
• Morocco
• Mozambique
• Namibia
• Netherlands
• New Zealand
• North Macedonia
• Norway
• Oman
• Pakistan
• Panama
• Peru
• Philippines
• Poland
• Portugal
• Qatar
• Romania
• Rwanda
• Saint Lucia
• Senegal
• Serbia
• Singapore
• Slovakia
• Slovenia
• South Africa
• Spain
• Sri Lanka
• Sweden
• Switzerland
• Taiwan
• Tanzania
• Thailand
• Trinidad and Tobago
• Tunisia
• Türkiye
• United Arab Emirates
• United Kingdom
• United States
• Uzbekistan
• Vietnam

The work

Create and assess historical evaluation material for AI models. Your work will test whether responses use evidence responsibly and recognize the limits of historical interpretation.

• Write scenarios that test source criticism, historical methods, and competing explanations for events.
• Prepare reference answers showing how evidence supports or limits an interpretation.
• Rate AI responses for factual accuracy, historical context, and awareness of different historical interpretations.
• Flag responses that distort evidence, invent causes, or project present-day assumptions onto the past.

What you need and what it pays

• Pay: $50 to $100 per hour, paid weekly through Stripe.
• Schedule: Part-time contractor work with a commitment of 20 or more hours per week. There is no stated maximum, and workload can vary from week to week.
• Location: Remote, open to candidates in eligible countries.
• Language: Clear written English is required.
• Education and experience: An advanced degree in history or a closely related field, plus at least two years of teaching, research, archival, or published historical work.
• Skills: Deep knowledge of a historical period or region, experience with primary sources, and the ability to weigh conflicting sources and explain what the evidence supports.
• Helpful experience: A PhD with peer-reviewed publications, archival research, public history work, or reading knowledge of relevant research languages.

About AI training work

AI training work uses human examples and judgments to help AI systems learn, including writing scenarios and evaluating model responses. Historical expertise helps ensure that evaluations distinguish evidence-based reasoning from confident but unsupported claims.

Review AI responses against US architecture, building, accessibility, energy, and fire codes using real construction documents. This remote contract offers flexible project-based work and pays up to $62.50 per hour.

Compare and rank AI-generated responses for Spanish-speaking users in this remote, project-based role open to candidates in Mexico. Work asynchronously with no set schedule or minimum hours, earning up to $25 per hour.

Review and compare AI-generated responses using Singaporean Mandarin, explain your judgments in clear written feedback, and work remotely with no fixed schedule. Pay is up to $30 per hour.

Evaluate and rank AI-generated responses in Bahasa Indonesian, explain your decisions, and give feedback that improves personalization. This remote, asynchronous project offers up to $15 per hour for completed work.

Evaluate and rank AI-generated responses in Spanish, explain your judgments, and help improve personalized answers. This remote Mexico-based project offers up to $25 per hour with no fixed schedule or minimum weekly hours.