AI Operations Benchmark Architect (Remote)

Synthires; United States; Remote; USD 62,000 - 124,000; Part time

Job summary

Synthires is seeking a remote Business Operations Expert to evaluate and improve AI-driven systems through structured benchmark tasks. You will transform real-world workflows into task sets with clear instructions, supporting materials, and objective grading criteria.

The role emphasizes SOPs, QA checklists, and process documentation to ensure consistent evaluation of AI outputs. You will work independently, designing evidence-based, measurable tasks for global applications.

Qualifications

• At least 5 years in business operations, operations reporting, process design, or workflow management.
• Own operational processes, not just supervisory roles.
• Experience creating or applying structured standards (SOPs, QA checklists, process docs, SLAs, training assessments).
• Strong written and verbal English, B2 minimum (C1 preferred).
• Translate complex workflows into clearly defined, measurable tasks.

Responsibilities

• Design realistic, multi-step tasks based on real-world operations (reporting, process design, workflow mgmt).
• Define objective grading criteria for consistent evaluations across reviewers.
• Develop tasks requiring critical thinking and interpretation of multiple documents.
• Create or source supporting materials (spreadsheets, exports, process docs, operational reports).
• Identify and flag ambiguous/ungradable tasks to meet evaluation standards.
• Deliver approved tasks on schedule with required quality.

Skills

Excel proficiency

English communication

Independent work

Operational understanding

Tools

Excel

Job description

Synthires is seeking a remote Business Operations Expert to evaluate and improve AI-driven systems through structured benchmark tasks. You will transform real-world workflows into task sets with clear instructions, supporting materials, and objective grading criteria.

The role emphasizes SOPs, QA checklists, and process documentation to ensure consistent evaluation of AI outputs. You will work independently, designing evidence-based, measurable tasks for global applications.