Remote Operations Benchmark Designer

Zekai; United States; Remote; USD 74,000 - 124,000; Full time

Job summary

Zekai is seeking a Business Operations Expert for a fully remote, contract-based engagement. You will design multi-step operations tasks with objective grading criteria to measure AI system performance, drawing on real-world workflows and documentation.

The role emphasizes hands-on operations experience, strong Excel skills, and clear, objective assessments. Open to applicants worldwide; strong English (B2/C1) required and pay is up to $90/hour equivalent.

Qualifications

• 5+ years of hands-on responsibility in business operations, operations reporting, process design, or workflow management.
• Experience creating or applying structured standards: SOPs, QA checklists, process documentation, service level definitions, or training assessments.
• Strong Excel capability and comfort reasoning across multiple documents at once.
• Strong English, written and spoken — B2 minimum, C1 preferred.
• AI or LLM evaluation experience is a plus, but not required.

Responsibilities

• Design multi-step tasks drawn from real operations work with realistic reference files and clear instructions.
• Define objective grading criteria so reviewers would reach the same verdict.
• Build tasks that require judgment and source materials beyond lookup.
• Create or source supporting materials: spreadsheets, system exports, process docs.
• Flag ambiguous or ungradable tasks and deliver on schedule.
• Deliver approved tasks on schedule and at required quality level.

Skills

Operations experience

English proficiency

Task design & evaluation

Attention to detail

Spreadsheet reasoning

Tools

Excel

Job description

Zekai is seeking a Business Operations Expert for a fully remote, contract-based engagement. You will design multi-step operations tasks with objective grading criteria to measure AI system performance, drawing on real-world workflows and documentation.

The role emphasizes hands-on operations experience, strong Excel skills, and clear, objective assessments. Open to applicants worldwide; strong English (B2/C1) required and pay is up to $90/hour equivalent.