AI Evaluation & Research Analyst

Executive Staff Recruiters / ESR Healthcare

United States

Remote

USD 34,000 - 55,000

Full time

14 days+

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Executive Staff Recruiters / ESR Healthcare is seeking a Business Analyst (Computer Use Agent) - II to support a Computer-Using Agent evaluation project. You will review AI-generated responses, perform online research, and annotate findings to improve AI instruction understanding.

Responsibilities include analyzing complex content, verifying claims, solving analytical tasks, creating evaluation scenarios, and providing detailed feedback. Strong English and research skills are required.

Qualifications

  • Excellent English communication and reading comprehension required.
  • Strong analytical, logical, critical, and creative thinking.
  • Ability to identify reliable information and distinguish unsupported claims.
  • Familiarity with Excel, Google Sheets, Docs, and Workspace.

Responsibilities

  • Analyze, summarize, and structure complex content clearly and accurately.
  • Conduct online research to verify claims and evidence.
  • Solve analytical, logical reasoning, data interpretation, and puzzle questions.
  • Create scenarios to evaluate AI model performance.
  • Review AI outputs with detailed ratings and feedback.

Skills

Analytical thinking
Critical thinking
English communication
Research skills
Independent work

Education

Bachelor's degree
Related field degree

Tools

Excel
Google Sheets
Google Docs
Google Workspace

Job description

Executive Staff Recruiters / ESR Healthcare is seeking a Business Analyst (Computer Use Agent) - II to support a Computer-Using Agent evaluation project. You will review AI-generated responses, perform online research, and annotate findings to improve AI instruction understanding.

Responsibilities include analyzing complex content, verifying claims, solving analytical tasks, creating evaluation scenarios, and providing detailed feedback. Strong English and research skills are required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Evaluation & Research Analyst
AI Evaluation & Research Analyst

Turing • United States

Remote
USD 55,000 - 83,000
AI Evaluation & Insight Analyst
AI Evaluation & Insight Analyst

Turing • United States

Remote
USD 34,000 - 55,000
Remote Intelligence Analyst - AI Benchmark Evaluator
Remote Intelligence Analyst - AI Benchmark Evaluator

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 55,000 - 96,000
AI Response Evaluation Analyst
AI Response Evaluation Analyst

Gramian Consulting Group • United States

Remote
USD 70,000 - 95,000
Remote Educational AI Analyst (Contract)
Remote Educational AI Analyst (Contract)

Weekday • Oregon

Hybrid
USD 34,000 - 49,000
Remote AI Evaluation Specialist (English)
Remote AI Evaluation Specialist (English)

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 60,000 - 90,000
Business Analyst (Computer Use Agent) - II
Business Analyst (Computer Use Agent) - II

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 34,000 - 55,000
Remote Educational Research Analyst (AI & Education)
Remote Educational Research Analyst (AI & Education)

Crossing Hurdles • United States

Remote
USD 34,000 - 49,000
AI Evaluation & Research Analyst (Freelance)
AI Evaluation & Research Analyst (Freelance)

OpenTrain AI, Inc. • United States

Remote
USD 28,000 - 55,000
Part-time contractor
AI Evaluation & Requirements Analyst
AI Evaluation & Requirements Analyst

Codefeast • United States

On-site
USD 65,000 - 110,000