Remote Religion & History AI Evaluation Specialist

remote work; United States; Remote; USD 8,300 - 90,000; Part time

Job summary

Meridial is building AI training data for large language models with a focus on religious studies, history, and cultural contexts. This freelance, remote role involves evaluating model reasoning, documenting errors, and providing feedback to improve prompts and evaluation methods.

You'll engage with language models on religious and historical scenarios, capture reproducible error traces, and contribute to prompts and evaluation frameworks.

Qualifications

• Background or strong interest in world religions, theology, religious history, philosophy of religion, or related humanities fields.
• Ability to articulate reasoning and interpretive steps clearly.
• Comfort working with AI evaluation tasks and documenting complex scenarios.
• Entry-level applicants welcome, with coursework or independent study considered.

Responsibilities

• Engage language models with religious and historical scenarios and analytical questions.
• Evaluate accuracy, neutrality, and logical consistency of model outputs.
• Capture reproducible error traces and provide structured feedback.
• Document failure modes related to beliefs, texts, and cultural contexts.
• Identify oversimplifications or inaccuracies in model interpretations.
• Contribute to prompts, evaluation frameworks, and reasoning quality improvements.

Skills

World religions knowledge

Analytical reasoning

Clear articulation of reasoning

Education

Courses or independent study in humanities

Job description

Meridial is building AI training data for large language models with a focus on religious studies, history, and cultural contexts. This freelance, remote role involves evaluating model reasoning, documenting errors, and providing feedback to improve prompts and evaluation methods.

You'll engage with language models on religious and historical scenarios, capture reproducible error traces, and contribute to prompts and evaluation frameworks.