Domain Advisor Consultant

Agency

United States

Remote

USD 96,000 - 193,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Agency is seeking highly accomplished independent consultants to help ground truth AI outputs. You will review criteria for evaluating AI results, create and certify Golden Tasks, and analyze failures like hallucinations and logic errors to support rigorous testing.

As an independent contractor in your country of residence, you will articulate complex reasoning in writing and help define robust ground-truth rubrics used to train large language models.

Qualifications

  • Elite domain mastery via PhD/MD/JD or equivalent recognized status.
  • Independent consultant, freelancer, or academic leader.
  • Ability to articulate complex reasoning clearly in writing.
  • Registration as an independent contractor in your country of residence.

Responsibilities

  • Review and advise on quality criteria used to evaluate AI outputs
  • Create, edit, or certify "Golden Tasks" to serve as ground truth for model training
  • Analyze model failures such as hallucinations and logical fallacies
  • Provide technical breakdowns of model errors and expert-level approaches
  • Consult on the complexity and nuance of specific prompts to ensure rigorous testing

Skills

Independent consultant status
Clear written reasoning

Education

Elite domain mastery via PhD/MD/JD or equivalent

Job description

Responsibilities
  • Review and advise on quality criteria used to evaluate AI outputs
  • Create, edit, or certify "Golden Tasks" to serve as ground truth for model training
  • Analyze model failures such as hallucinations and logical fallacies
  • Provide technical breakdowns of model errors and expert-level approaches
  • Consult on the complexity and nuance of specific prompts to ensure rigorous testing
Requirements
  • Elite domain mastery via advanced degrees (PhD, MD, JD) or equivalent industry-recognized status
  • Current status as an independent consultant, freelancer, or academic leader
  • Ability to articulate complex reasoning processes clearly in writing
  • Proper registration to operate as an independent contractor in your country of residence
About the Company

We partner with elite Subject Matter Experts to define the "ground truth" for Generative AI, architecting the rubrics that teach Large Language Models how to think like industry experts.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Meridial • United States

Remote
USD 100,000 - 150,000
Flexible revenue stream
Intellectual challenge
Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Agency • United States

Remote
USD 207,000 - 358,000
Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Meridial • United States

Remote
USD 207,000 - 413,000
Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Remote • San Francisco (CA)

Remote
USD 207,000 - 413,000
Gen AI Domain Master & Ground-Truth Consultant
Gen AI Domain Master & Ground-Truth Consultant

Agency • United States

Remote
USD 96,000 - 193,000
AI Ground Truth Architect & Domain Expert
AI Ground Truth Architect & Domain Expert

Agency • United States

Remote
USD 207,000 - 358,000
AI Ground-Truth Architect for Elite Domain Experts
AI Ground-Truth Architect for Elite Domain Experts

Meridial • United States

Remote
USD 207,000 - 413,000
Remote Elite Domain Advisor for AI Ground Truth
Remote Elite Domain Advisor for AI Ground Truth

Remote • San Francisco (CA)

Remote
USD 207,000 - 413,000
Domain Expert - Art
Domain Expert - Art

Turing • United States

Remote
USD 55,000 - 110,000
Contractor assignment
8 weeks duration
Domain Contributor - Evaluation Specialist
Domain Contributor - Evaluation Specialist

Remotebridge • United States

Remote
USD 83,000 - 165,000