Domain Advisor Consultant (Subject Matter Expert)

Remote

San Francisco (CA)

Remote

USD 207,000 - 413,000

Full time

11 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Remote is seeking elite Domain Advisors to partner on high-impact AI evaluation and training projects. This strictly independent contractor engagement focuses on defining the Gold Standard rubrics that teach models to think like an expert in your field.

You will operate under a flexible SOW, delivering rubric architecture, golden data curation, expert gap analysis, and advisory on prompt complexity. Remote professionals with autonomy and industry authority are encouraged to apply.

Qualifications

  • Elite domain mastery with advanced degree or equivalent status.
  • Independent consultant with own workflows and methodologies.
  • Willing to define gold standards for AI evaluation in your field.
  • Strong written reasoning and communication capabilities.

Responsibilities

  • Rubric architecture review for AI outputs.
  • Create or certify 'Golden Tasks' for model training.
  • Analyze model failures and provide expert breakdowns of how to improve.
  • Advise on the difficulty and nuance of prompts and scenarios.

Skills

Domain mastery
Independent consultant
AI evaluation
Articulate reasoning

Education

Advanced degree (PhD/MD/JD)

Job description

Defining the future of work & living globally

5,637 jobs · 6 companies

Domain Advisor Consultant (Subject Matter Expert)

Engagement Type: Business-to-Business (B2B) / Independent Contractor

Location: Remote

The Opportunity: Define the "Ground Truth" for Generative AI

We are looking to engage elite Subject Matter Experts (SMEs) to partner with us on high-impact AI evaluation and training projects. We are not looking for generalists; we are seeking established authorities—the top 1% in their respective fields—who are eager to apply their deep domain knowledge to shape the reasoning, accuracy, and safety of next-generation Large Language Models (LLMs).

This is a consulting engagement for independent professionals who want to help define what "perfection" looks like in their industry. You will not just be grading AI; you will be architecting the "Gold Standard" rubrics that teach models how to think like an expert.

Scope of Services & Deliverables

This engagement focuses on high-level advisory and specialized analysis. Consultants will operate under a Statement of Work (SOW) to provide the following deliverables:

Rubric Architecture: Review and advise on the quality criteria used to evaluate AI outputs. You will determine if the AI’s logic holds up to professional scrutiny in your field.

"Golden" Data Curation: Create, edit, or certify "Golden Tasks"—benchmark examples of perfect prompts and responses that serve as the ground truth for model training.

Expert Gap Analysis: Analyze model failures (hallucinations, logical fallacies) and provide technical breakdowns of why the model failed and how a human expert would have approached the problem.

Advisory on Complexity: Consult on the difficulty and nuance of specific prompts to ensure the AI is being tested against sufficiently rigorous scenarios.

Consultant Profile: Who We Are Looking To Partner With

We are seeking independent business owners, freelancers, and academic leaders who possess:

Elite Domain Mastery: Advanced degrees (PhD, MD, JD) or equivalent industry-recognized status (e.g., Senior Principal Engineer, Published Author, Award-Winning Creative).

Professional Autonomy: You currently operate as an independent consultant or freelancer and have your own workflows, equipment, and professional methodology.

Interest in Shaping Technology: While prior experience in AI evaluation is a bonus, it is absolutely not required. We want industry veterans who are eager to set the "gold standard" for how AI should operate within their specific profession.

Articulate Reasoning: The ability to not just know the right answer, but to articulate the reasoning process clearly in writing.

Engagement Structure & Compliance

This is a strictly non-employee, independent contractor opportunity designed for professionals who manage their own business operations.

Engagements are project-based and non-exclusive, allowing you to continue working with other clients

You have flexibility in how you complete deliverables, in alignment with project requirements

Scope, timelines, and compensation are defined in advance for each assignment

Remote & Independent: You provide your own workspace and equipment.

Global Compliance: Candidates must be properly registered to operate as independent contractors in their country of residence.

Why Top-Tier Consultants Partner With Us

Intellectual Challenge: This is rare, cerebral work that challenges you to deconstruct your own expertise to train a machine.

High-Value Impact: Your input directly influences the safety and capability of models used by millions.

Flexible Revenue Stream: Supplement your primary consulting business with flexible, high-value project work.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Meridial • United States

Remote
USD 100,000 - 150,000
Flexible revenue stream
Intellectual challenge
Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Meridial • United States

Remote
USD 207,000 - 413,000
Domain Advisor Consultant (Subject Matter Expert)
Domain Advisor Consultant (Subject Matter Expert)

Agency • United States

Remote
USD 207,000 - 358,000
Domain Advisor Consultant
Domain Advisor Consultant

Agency • United States

Remote
USD 96,000 - 193,000
Remote: Elite Domain SME for AI Ground Truth & Rubrics
Remote: Elite Domain SME for AI Ground Truth & Rubrics

Meridial • United States

Remote
USD 100,000 - 150,000
Flexible revenue stream
Intellectual challenge
Ex-MBB Strategy Consultant – AI Training (Remote)
Ex-MBB Strategy Consultant – AI Training (Remote)

Mindrift • Arizona

Remote
USD 50,000 - 83,000
Remote work
Ex-MBB Strategy Consultant – AI Training (Remote)
Ex-MBB Strategy Consultant – AI Training (Remote)

Mindrift • Colorado

Remote
USD 55,000 - 83,000
Remote work
Project-based engagement
Individual contributor role
Independent Consultant/Entrepreneur, Finance, Data & Engineering (Domain Expert)
Independent Consultant/Entrepreneur, Finance, Data & Engineering (Domain Expert)

micro1 Inc. • United States

Remote
USD 83,000 - 131,000
AI Ground Truth Architect & Domain Expert
AI Ground Truth Architect & Domain Expert

Agency • United States

Remote
USD 207,000 - 358,000
Independent Consultant, Sales, Marketing & Business Strategy (Domain Expert)
Independent Consultant, Sales, Marketing & Business Strategy (Domain Expert)

Micro1 • United States

Remote
USD 138,000 - 276,000