Business Analyst (Computer Use Agents) · Turing Turing · Varies · remote · 4d ago Varies 4d ago

Benture; San Francisco (CA); Hybrid; USD 34,000 - 55,000; Part time

Job summary

Turing, a San Francisco-based company, seeks a Business Analyst (Computer Use Agents) for a remote, hourly contract of 16 weeks. You will review AI-generated responses, validate information via online research, and provide detailed annotations and ratings to improve model performance.

Strong English, analytical thinking, and independent work under timelines are essential. Expected start around mid-October with potential extension.

Qualifications

• Excellent English communication and reading comprehension.
• Strong analytical, logical, and creative problem-solving skills.
• Ability to verify claims using online research.
• Ability to interpret data, identify patterns, and perform basic calculations.
• Ability to work independently with detailed instructions and timelines.

Responsibilities

• Analyze, summarize, and structure complex content clearly and accurately.
• Conduct online research to verify claims, sources, and evidence.
• Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
• Create scenarios and questions to evaluate and improve large language model performance.
• Review AI-generated responses and provide detailed ratings, annotations, explanations, and feedback.

Skills

English fluency

Analytical thinking

Research skills

Critical thinking

Independent work

Education

Bachelor's degree or in progress (related field)

Tools

Excel

Google Sheets

Google Docs

Google Workspace

Job description

Business Analyst (Computer Use Agents) | Remote | Hourly contract, 16 weeks

About the Role

You'll work on Turing's Computer-Using Agent (CUA) evaluation project, which assesses how AI systems understand instructions, analyze information, reason through problems, and complete tasks in digital environments. The role involves reviewing AI-generated responses and actions, validating information through online research, assessing accuracy and task completion, identifying errors or gaps, and providing detailed annotations, ratings, and explanations. Turing is a San Francisco-based company that works with frontier AI labs on data, evaluations, and reinforcement learning environments.

What You’ll Do

• Analyze, summarize, and structure complex written content clearly and accurately.
• Conduct online research to verify claims, sources, and supporting evidence.
• Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
• Create scenarios and questions to evaluate and improve large language model performance.
• Review AI-generated responses and provide detailed ratings, annotations, explanations, and feedback.

Requirements

• Excellent English communication and reading comprehension skills.
• Analytical, logical, critical, and creative thinking to solve complex problems.
• Ability to identify reliable information and distinguish it from inaccurate or unsupported claims.
• Ability to interpret data, identify patterns, compare information, and perform basic calculations.
• Ability to work independently while following detailed instructions, quality standards, and timelines.

Preferred Qualifications

• Degree (held or in progress) in Engineering, Literature, Journalism, Communications, Arts, Statistics, Business, or a related field.
• Experience in business analysis, research, copywriting, journalism, technical writing, editing, translation, or similar fields.
• Candidates without a bachelor's degree may be considered based on relevant experience and demonstrated skills.
• Familiarity with Excel, Google Sheets, Google Docs, and Google Workspace.
• Interest in artificial intelligence, large language models, online research, and emerging technologies.

Engagement Details

• Hourly, long-term engagement.
• Duration: 16 weeks, with potential opportunities for extension.
• Expected start date: around 15 October.

Selection Process

The selection process includes an online assessment of about 45-50 minutes, to be completed on a desktop or laptop. Candidates who pass the internal assessment review will be considered for the role.