Domain Advisor Consultant (Subject Matter Expert)

Jobgether; México; Remote; MXN 90,000 - 150,000; Full time

Benefits offered by this job

Remote work

Flexible delivery

Defined compensation

Non-exclusive engagements

Project-based flexibility

Intellectual challenge

Meaningful impact

Global engagement

Additional revenue opportunity

Job summary

Jobgether is seeking a Domain Advisor Consultant (Subject Matter Expert) based in Mexico to define AI evaluation standards and benchmarks. You will craft rigorous evaluation criteria, prompts, and references for AI training and testing, applying elite-level expertise in your field.

Engagements are project-based and designed for independent professionals seeking autonomy. The role focuses on assessing model reasoning, addressing hallucinations, and documenting expert recommendations for technical

Qualifications

• Elite-level expertise in a specialized domain with advanced credentials.
• Independent contractor/freelancer experience.
• Excellent written communication to explain complex concepts clearly.
• Ability to translate domain knowledge into evaluation criteria and guidance.

Responsibilities

• Review and advise on evaluation criteria and scoring rubrics.
• Create, edit, and validate benchmark tasks, prompts, and responses.
• Analyze model failures and provide expert explanations and improvements.
• Assess difficulty of evaluation scenarios for rigorous testing.
• Document expert reasoning and recommendations for technical teams.
• Deliver outcomes within Statements of Work timelines while maintaining autonomy.
• Contribute insights to improve AI system capability, reliability and safety.

Skills

Elite-level expertise

Independent contractor experience

Strong written communication

Ability to translate domain knowledge

Education

Advanced degree (PhD/MD/JD)

Job description

Domain Advisor Consultant (Subject Matter Expert)

Empresa : Jobgether Tipo de empleo : Tiempo completo Remote / Work from Home JobCopilot will tailor your resume and auto-fill the application

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Domain Advisor Consultant (Subject Matter Expert) based in Mexico.

This is an opportunity for an established subject matter expert to help define the standards by which next-generation AI systems are evaluated and improved. You will bring deep professional or academic expertise to complex AI evaluation and training projects. The role focuses on creating rigorous benchmarks, assessing model reasoning, and identifying gaps in AI-generated outputs. You will help translate expert knowledge into clear evaluation criteria, reference examples, and actionable guidance. Engagements are project-based, flexible, and designed for independent professionals who value autonomy. Your work can directly influence the accuracy, reasoning quality, and safety of AI systems used at significant scale. This is a highly analytical consulting opportunity for experts who want to shape how AI performs within their field.

Accountabilities

• Review and advise on evaluation criteria and scoring rubrics to determine whether AI-generated outputs meet professional standards within your area of expertise.
• Create, edit, and validate high-quality benchmark tasks, prompts, and responses that can serve as trusted reference data for AI training and evaluation.
• Analyze model failures, including hallucinations, flawed reasoning, and logical inconsistencies, and provide expert explanations of their causes and potential improvements.
• Assess the complexity, nuance, and difficulty of evaluation scenarios to ensure AI systems are tested against sufficiently rigorous and realistic professional challenges.
• Clearly document expert reasoning and recommendations so that technical teams can translate domain knowledge into practical AI evaluation and training methodologies.
• Work under project-specific Statements of Work, delivering agreed outcomes within defined timelines while maintaining your independent professional practices.
• Contribute specialized insight that helps improve the capability, reliability, and safety of AI systems within your field.

Requirements

• Demonstrated elite-level expertise in a specialized professional or academic domain, supported by an advanced degree such as a PhD, MD, JD, or equivalent industry-recognized achievement.
• Recognized professional standing, such as senior/principal-level leadership, significant publications, major awards, substantial industry contributions, or comparable evidence of domain mastery.
• Current experience as an independent consultant, freelancer, business owner, academic leader, or other professional operating with a high degree of autonomy.
• Strong ability to distinguish high-quality from flawed reasoning and to explain complex concepts clearly in written form.
• Ability to apply deep subject matter expertise to unfamiliar or ambiguous problems and establish what constitutes an accurate, rigorous, and professionally sound response.
• Excellent written communication skills, with the ability to articulate nuanced technical or professional reasoning in a structured and accessible way.
• Prior experience with AI evaluation, machine learning, or generative AI is beneficial but not required.
• Ability to manage your own workspace, equipment, schedule, and professional workflow as an independent contractor.
• Proper registration and authorization to operate as an independent contractor in your country of residence.

Benefits

• Project-based flexibility:Choose assignments that complement your existing consulting, freelance, or professional work.
• Non-exclusive engagements:Continue working with other clients while participating in projects.
• Flexible delivery:Manage how you complete agreed deliverables in alignment with project requirements and deadlines.
• Defined compensation:Scope, timelines, and compensation are established in advance for each assignment.
• Remote work:Work independently from your own location using your own workspace and equipment.
• Intellectual challenge:Apply and deconstruct your expertise in rare, highly analytical work designed to improve AI reasoning.
• Meaningful impact:Help shape the accuracy, capability, and safety of AI systems through expert-level evaluation and guidance.
• Additional revenue opportunity:Supplement your existing professional or consulting income with specialized project work.
• Global engagement:Collaborate on AI-focused initiatives from anywhere you are legally able to operate as an independent contractor.

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.