AI Model Evaluator - Finance & Accounting (Contract)

Mercor; United States; Remote; USD 68,880 - 103,320; Part time

Job summary

A leading AI talent connection firm based in the United States is seeking an AI Model Evaluator to assess AI-generated responses for accuracy and practical usefulness. Candidates must hold a Master’s degree and possess professional experience in Finance or a related field. The position is contract-based with a pay rate of $50-$75/hour, requiring a commitment of 20 hours per week. Strong communication and reasoning skills are essential for success in this role.

Qualifications

• Master’s degree or higher required.
• Professional experience in a relevant field is essential.
• Familiarity with industry-specific standards and regulations is necessary.

Responsibilities

• Write realistic prompts reflecting professional and consumer needs.
• Evaluate AI responses for accuracy and practical usefulness.
• Identify fabrications and misleading reasoning in model outputs.
• Score model responses using structured rubrics.
• Provide written justifications with evidence for evaluations.

Skills

Strong written communication

Critical reasoning skills

Education

Master’s degree or higher in Finance, Accounting, or a relevant professional field

Job description

A leading AI talent connection firm based in the United States is seeking an AI Model Evaluator to assess AI-generated responses for accuracy and practical usefulness. Candidates must hold a Master’s degree and possess professional experience in Finance or a related field. The position is contract-based with a pay rate of $50-$75/hour, requiring a commitment of 20 hours per week. Strong communication and reasoning skills are essential for success in this role.