Gen AI Domain Master & Ground-Truth Consultant

Agency

United States

Remote

USD 96,000 - 193,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Agency is seeking highly accomplished independent consultants to help ground truth AI outputs. You will review criteria for evaluating AI results, create and certify Golden Tasks, and analyze failures like hallucinations and logic errors to support rigorous testing.

As an independent contractor in your country of residence, you will articulate complex reasoning in writing and help define robust ground-truth rubrics used to train large language models.

Qualifications

  • Elite domain mastery via PhD/MD/JD or equivalent recognized status.
  • Independent consultant, freelancer, or academic leader.
  • Ability to articulate complex reasoning clearly in writing.
  • Registration as an independent contractor in your country of residence.

Responsibilities

  • Review and advise on quality criteria used to evaluate AI outputs
  • Create, edit, or certify "Golden Tasks" to serve as ground truth for model training
  • Analyze model failures such as hallucinations and logical fallacies
  • Provide technical breakdowns of model errors and expert-level approaches
  • Consult on the complexity and nuance of specific prompts to ensure rigorous testing

Skills

Independent consultant status
Clear written reasoning

Education

Elite domain mastery via PhD/MD/JD or equivalent

Job description

Agency is seeking highly accomplished independent consultants to help ground truth AI outputs. You will review criteria for evaluating AI results, create and certify Golden Tasks, and analyze failures like hallucinations and logic errors to support rigorous testing.

As an independent contractor in your country of residence, you will articulate complex reasoning in writing and help define robust ground-truth rubrics used to train large language models.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Ground Truth Architect & Domain Expert
AI Ground Truth Architect & Domain Expert

Agency • United States

Remote
USD 207,000 - 358,000
Domain Advisor Consultant
Domain Advisor Consultant

Agency • United States

Remote
USD 96,000 - 193,000
Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Agency • United States

Remote
USD 207,000 - 358,000
Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Meridial • United States

Remote
USD 207,000 - 413,000
AI Ground-Truth Architect for Elite Domain Experts
AI Ground-Truth Architect for Elite Domain Experts

Meridial • United States

Remote
USD 207,000 - 413,000
Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Meridial • United States

Remote
USD 100,000 - 150,000
Flexible revenue stream
Intellectual challenge
Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Remote • San Francisco (CA)

Remote
USD 207,000 - 413,000
Remote Elite Domain Advisor for AI Ground Truth
Remote Elite Domain Advisor for AI Ground Truth

Remote • San Francisco (CA)

Remote
USD 207,000 - 413,000
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Anyone AI Inc. • United States

Remote
USD 28,000 - 48,000
AI Generalist Contractor — Remote, Real-World Tasks
AI Generalist Contractor — Remote, Real-World Tasks

YO AI Labs • New York (NY)

Remote
USD 34,000 - 55,000