Administrative Workflow AI Evaluation Expert

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 60,000 - 90,000; Full time

Job summary

OpenTrain AI, Inc. is seeking an Administrative Workflow AI Evaluation Expert to design expert-authored evaluation tasks for a frontier AI benchmark.

You will translate administrative challenges into structured scenarios that test how AI systems coordinate tools, follow processes, and complete real-world operations. Candidates with five+ years in professional administration, strong written and verbal communication, and attention to detail will thrive.

Qualifications

• At least five years of experience supporting teams in a professional administrative role.
• Ownership of ongoing, recurring workflows and documented procedures.
• Strong written and verbal communication and professional correspondence.
• Comfort with CSVs, PDFs, spreadsheets, and technical documents.

Responsibilities

• Design process-driven evaluation tasks for admin benchmarking.
• Assemble realistic artifacts like emails, calendar entries, receipts, notes.
• Define solutions and document step-by-step decisions for experts.
• Build rubrics with 35+ criteria on process adherence and judgment.

Skills

Administrative experience

Communication skills

Attention to detail

Professional correspondence

Tools

CSV

PDF

Spreadsheets

Technical documents

Job description

About OpenTrain

OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role

OpenTrain is recruiting for an Administrative Workflow AI Evaluation Expert to design and produce expert-authored evaluation tasks for a frontier AI benchmark. You will translate authentic administrative challenges into structured scenarios that test how AI systems coordinate tools, follow processes, make judgment calls, and complete realistic operational work. This is a domain-expert opportunity for experienced administrative professionals, and prior AI training experience is not required.

What you will do

You will design process-driven evaluation tasks involving calendar reconciliation, travel and expense workflows, records management, and professional correspondence. You will assemble realistic supporting artifacts, including emails, calendar entries, receipts, meeting notes, and contact records. You will define correct solutions and document the step-by-step decisions an experienced professional would make. You will build comprehensive rubrics with more than 35 criteria covering process adherence and nuanced judgment. You will document administrative workflows, identify improvement opportunities, and help calibrate task complexity against real-world professional challenges.

Required skills

You should have at least five years of experience supporting teams or departments in a professional administrative capacity within a mid-to-large organization. The role requires ownership of ongoing, recurring workflows, experience documenting and improving inherited administrative procedures, strong written and verbal communication, professional correspondence skills, and exceptional attention to detail. You should also be comfortable working with digital tools and data formats such as CSVs, PDFs, spreadsheets, and technical documents.

Helpful background

Experience coordinating multiple administrative tools and workflows, creating clear process documentation, and applying sound judgment to ambiguous operational situations will help you produce high-quality evaluation scenarios. The work is designed for professionals who can explain why a particular administrative action is correct and distinguish process compliance from thoughtful judgment.

Why work with OpenTrain

OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.