Finance AI Model Evaluator - Contract, 20 hrs/week

Mercor

San Francisco (CA)

Remote

AUD 68,880 - 103,320

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

A leading tech company based in Australia is seeking an AI Model Evaluator on a contract basis. The role involves evaluating AI-generated responses, writing prompts, and providing justifications based on specific criteria. Ideal candidates will hold a Master's degree in Finance or Accounting, possess strong communication and critical reasoning skills, and have relevant professional experience. This position supports approximately 20 hours of work per week with a competitive pay rate of $50–$75 per hour.

Qualifications

  • Professional experience applying domain expertise in a practitioner or advisory capacity.
  • Familiarity with regulations or clinical guidelines.

Responsibilities

  • Write realistic prompts that reflect domain-specific guidance.
  • Evaluate AI-generated responses for accuracy and usefulness.
  • Identify misleading claims across model outputs.
  • Score and rank model responses using rubrics.
  • Provide written justifications for evaluations.

Skills

Strong written communication
Critical reasoning
Industry-specific standards knowledge

Education

Master’s degree or higher in Finance, Accounting, or relevant field

Job description

A leading tech company based in Australia is seeking an AI Model Evaluator on a contract basis. The role involves evaluating AI-generated responses, writing prompts, and providing justifications based on specific criteria. Ideal candidates will hold a Master's degree in Finance or Accounting, possess strong communication and critical reasoning skills, and have relevant professional experience. This position supports approximately 20 hours of work per week with a competitive pay rate of $50–$75 per hour.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Model Evaluator - Finance & Accounting (Contract)
AI Model Evaluator - Finance & Accounting (Contract)

Mercor • United States

Remote
USD 68,880 - 103,320
Finance AI Specialist (Remote, Contract)
Finance AI Specialist (Remote, Contract)

Turing • San Francisco (CA)

Remote
USD 137,760
Work on cutting-edge AI and finance
Flexible work environment
Competitive hourly compensation
Finance Analyst (Remote) - AI Research & Model Evaluation
Finance Analyst (Remote) - AI Research & Model Evaluation

Turing • Chicago (IL)

Remote
USD 55,104 - 96,432
Flexible remote work environment
Competitive hourly compensation
Opportunity to work at the cutting edge of AI and finance
Remote Finance Research Specialist for AI Model Evaluation
Remote Finance Research Specialist for AI Model Evaluation

Turing • United States

Remote
USD 41,328 - 68,880
Work on cutting edge of AI and finance
Fully remote and flexible work environment
Competitive hourly compensation
AI Finance Advisor & Model Evaluator (Remote)
AI Finance Advisor & Model Evaluator (Remote)

DataAnnotation • Oklahoma

Remote
USD 68,880 - 82,656
Choose projects to work on
Work on your own schedule
Bonuses for high-quality work
Remote Finance AI Evaluator (Contractor, 10-30h)
Remote Finance AI Evaluator (Contractor, 10-30h)

Recruitment Room • United States

Remote
USD 138,000 - 207,000
Accountant - AI Model Evaluator
Accountant - AI Model Evaluator

Journal of Accountancy • United States

Remote
USD 55,000 - 172,000
Work from home
Pay via PayPal
Bonus rates on some projects
AI Model Evaluator & Financial Analyst - Remote
AI Model Evaluator & Financial Analyst - Remote

DataAnnotation • North Carolina

Remote
USD 68,880 - 82,656
Flexible working hours
Choose your projects
Hourly pay starting at $50-$60 USD
+1
Remote Finance Expert: AI Model Evaluation & Strategy
Remote Finance Expert: AI Model Evaluation & Strategy

Turing • Seattle (WA)

Remote
USD 113,652 - 161,868
Work on cutting-edge AI and finance
Fully remote and flexible work environment
Competitive hourly compensation
Remote Finance AI Model Evaluator
Remote Finance AI Model Evaluator

Association of International Certified Professional Accountants • United States

Remote
USD 55,000 - 172,000
Work from home
Pay via PayPal
Bonus rates on some projects