Business Analyst (Computer Use Agent)

Turing; United States; Remote; USD 34,000 - 55,000; Part time

Job summary

Turing is seeking a Business Analyst to review AI responses and validate information accuracy for an evaluation project. You will assess AI outputs, perform online research, and provide structured annotations and feedback to improve model performance in reasoning and task completion.

The role is an hourly, long-term engagement based in the United States, with a start date around mid-October. You will work independently, following provided guidelines and timelines, contributing to high-quality

Qualifications

• Excellent English communication and reading comprehension.
• Apply analytical, logical, critical, and creative thinking to solve complex problems.
• Identify reliable information and distinguish it from inaccurate or unsupported claims.
• Interpret data, identify patterns, compare information, and perform basic calculations.
• Work independently while following detailed instructions, quality standards, and timelines.

Responsibilities

• Analyze, summarize, and structure complex written content clearly and accurately.
• Conduct online research to verify claims, sources, and supporting evidence.
• Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
• Create scenarios and questions to evaluate and improve large language model performance.
• Review AI-generated responses and provide detailed ratings, annotations, explanations, and feedback.

Skills

Business Analysis

Education

Engineering/Arts/Business related degree

Tools

Excel

Google Sheets

Google Docs

Google Workspace

Job description

Review AI responses and validate information for accuracy and clarity.

About Turing

Turing's mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality data, evaluations, and reinforcement learning environments that improve model capabilities in coding, reasoning, tool use, and multimodality. In coding, Turing is the largest and longest-running data provider in the category.

Role Overview

The Business Analyst works on a Computer-Using Agent (CUA) evaluation project designed to assess and improve how AI systems understand instructions, analyze information, reason through problems, and complete tasks in digital environments. The role involves reviewing AI-generated responses and actions, validating information through online research, assessing accuracy and task completion, identifying errors or gaps, and providing detailed annotations, ratings, and explanations

Job Responsibilities

• Analyze, summarize, and structure complex written content clearly and accurately.
• Conduct online research to verify claims, sources, and supporting evidence.
• Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
• Create scenarios and questions to evaluate and improve large language model performance.
• Review AI-generated responses and provide detailed ratings, annotations, explanations, and feedback.

Job Requirements

• Demonstrate excellent English communication and reading comprehension skills.
• Apply analytical, logical, critical, and creative thinking to solve complex problems.
• Identify reliable information and distinguish it from inaccurate or unsupported claims.
• Interpret data, identify patterns, compare information, and perform basic calculations.
• Work independently while following detailed instructions, quality standards, and timelines.

Preferred Qualifications

• Hold or pursue a degree in Engineering, Literature, Journalism, Communications, Arts, Statistics, Business, or a related field.
• Demonstrate relevant experience in business analysis, research, copywriting, journalism, technical writing, editing, translation, or similar fields.
• Candidates without a bachelor's degree may also be considered based on relevant experience and demonstrated skills.
• Demonstrate familiarity with Excel, Google Sheets, Google Docs, and Google Workspace.
• Show an interest in artificial intelligence, large language models, online research, and emerging technologies.

Selection Process

• Candidates who successfully pass our internal assessment review will be considered for this role

Project Details

• Engagement Type: Hourly, long-term engagement.
• Duration: 16 weeks, with potential opportunities for extension.
• Expected Start Date: Around 15 October or nearby dates.

Skills

Business Analysis