Remote AI Evaluation Analyst - 16-Week Contract

Benture; San Francisco (CA); Hybrid; USD 34,000 - 55,000; Part time

Job summary

Turing, a San Francisco-based company, seeks a Business Analyst (Computer Use Agents) for a remote, hourly contract of 16 weeks. You will review AI-generated responses, validate information via online research, and provide detailed annotations and ratings to improve model performance.

Strong English, analytical thinking, and independent work under timelines are essential. Expected start around mid-October with potential extension.

Qualifications

• Excellent English communication and reading comprehension.
• Strong analytical, logical, and creative problem-solving skills.
• Ability to verify claims using online research.
• Ability to interpret data, identify patterns, and perform basic calculations.
• Ability to work independently with detailed instructions and timelines.

Responsibilities

• Analyze, summarize, and structure complex content clearly and accurately.
• Conduct online research to verify claims, sources, and evidence.
• Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
• Create scenarios and questions to evaluate and improve large language model performance.
• Review AI-generated responses and provide detailed ratings, annotations, explanations, and feedback.

Skills

English fluency

Analytical thinking

Research skills

Critical thinking

Independent work

Education

Bachelor's degree or in progress (related field)

Tools

Excel

Google Sheets

Google Docs

Google Workspace

Job description

Turing, a San Francisco-based company, seeks a Business Analyst (Computer Use Agents) for a remote, hourly contract of 16 weeks. You will review AI-generated responses, validate information via online research, and provide detailed annotations and ratings to improve model performance.

Strong English, analytical thinking, and independent work under timelines are essential. Expected start around mid-October with potential extension.