Senior Domain Advisor & AI Evaluation Specialist (Remote)

Jobgether; México; A distancia; MXN 90.000 - 150.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work

Flexible delivery

Defined compensation

Non-exclusive engagements

Project-based flexibility

Intellectual challenge

Meaningful impact

Global engagement

Additional revenue opportunity

Descripción de la vacante

Jobgether is seeking a Domain Advisor Consultant (Subject Matter Expert) based in Mexico to define AI evaluation standards and benchmarks. You will craft rigorous evaluation criteria, prompts, and references for AI training and testing, applying elite-level expertise in your field.

Engagements are project-based and designed for independent professionals seeking autonomy. The role focuses on assessing model reasoning, addressing hallucinations, and documenting expert recommendations for technical

Formación

• Elite-level expertise in a specialized domain with advanced credentials.
• Independent contractor/freelancer experience.
• Excellent written communication to explain complex concepts clearly.
• Ability to translate domain knowledge into evaluation criteria and guidance.

Responsabilidades

• Review and advise on evaluation criteria and scoring rubrics.
• Create, edit, and validate benchmark tasks, prompts, and responses.
• Analyze model failures and provide expert explanations and improvements.
• Assess difficulty of evaluation scenarios for rigorous testing.
• Document expert reasoning and recommendations for technical teams.
• Deliver outcomes within Statements of Work timelines while maintaining autonomy.
• Contribute insights to improve AI system capability, reliability and safety.

Conocimientos

Elite-level expertise

Independent contractor experience

Strong written communication

Ability to translate domain knowledge

Educación

Advanced degree (PhD/MD/JD)

Descripción del empleo

Jobgether is seeking a Domain Advisor Consultant (Subject Matter Expert) based in Mexico to define AI evaluation standards and benchmarks. You will craft rigorous evaluation criteria, prompts, and references for AI training and testing, applying elite-level expertise in your field.

Engagements are project-based and designed for independent professionals seeking autonomy. The role focuses on assessing model reasoning, addressing hallucinations, and documenting expert recommendations for technical