Remote Operations Benchmark Designer

The Ai Training Company; United States; Remote; GBP 55,000 - 90,000; Full time

Job summary

The Ai Training Company is seeking experienced Business Operations professionals to design remote AI benchmark tasks based on real-world workflows. You will craft multi-step scenarios, supporting materials, and objective grading criteria to ensure reliable judgings.

The role emphasizes hands-on experience in operations, SOP development, and Excel analysis, with an emphasis on independent work and timely delivery. The project is remote and targets international collaboration.

Qualifications

• Minimum 5 years hands-on experience in business operations, operations reporting, process design, workflow management, or closely related field.
• Direct ownership of real operational processes or deliverables.
• Experience creating or applying SOPs, QA checklists, process documentation, service standards, or training assessments.
• Strong Excel skills and ability to analyze information across multiple documents.
• Ability to create realistic operational scenarios and supporting materials.
• Strong analytical reasoning and attention to detail.
• Ability to define clear and objective grading criteria.
• Ability to work independently and deliver high-quality work on schedule.

Responsibilities

• Design realistic multi-step tasks based on actual business operations workflows.
• Create scenarios involving reporting, process management, workflow execution, operational analysis, and quality assurance.
• Develop clear instructions and realistic supporting materials such as spreadsheets, system exports, reports, and process documentation.
• Define objective grading criteria that allow different qualified reviewers to reach consistent conclusions.
• Create tasks that require genuine judgment and careful interpretation rather than simple information lookup.
• Develop reference answers or expected outputs when required.
• Identify ambiguous, unrealistic, or ungradable tasks and refine them before submission.
• Review tasks for completeness, consistency, difficulty, and operational realism.
• Deliver approved benchmark tasks according to project quality standards and deadlines.

Skills

Business Ops

Process Improvement

Operations Analysis

Workflow

Job description

The Ai Training Company is seeking experienced Business Operations professionals to design remote AI benchmark tasks based on real-world workflows. You will craft multi-step scenarios, supporting materials, and objective grading criteria to ensure reliable judgings.

The role emphasizes hands-on experience in operations, SOP development, and Excel analysis, with an emphasis on independent work and timely delivery. The project is remote and targets international collaboration.