Remote AI Operations Researcher & Evaluation Designer

United States Digital Space LLC; Greater London; Hybrid; GBP 408,000 - 1,019,000; Full time

Job summary

Aptura is seeking Subject Matter Experts with operations experience to build business reviews, rollout packs, and performance decks for AI model evaluation.

Role involves designing tasks to probe AI in real-world workflows and collaborating with frontier teams to implement evaluated processes. Remote or in-office (Liverpool Street, London) options available, with compensation on task idea selection plus hourly evaluation design work.

Qualifications

• 3+ years in a business operations, program management, or process improvement role with deep hands-on PowerPoint work.
• Ability to define what "good" looks like precisely enough for someone else to grade against it.
• Attention to detail, and willingness to learn concepts in AI and data.

Responsibilities

• Designing "problems" to test state-of-the-art AI models on your workflows (ex. designing tasks that start mid-workflow).
• Working with frontier engineering/research teams to implement and evaluate AI systems on the designed real-world operations work.

Skills

Operations experience

Process improvement

Stakeholder management

Tools

PowerPoint

Job description

Aptura is seeking Subject Matter Experts with operations experience to build business reviews, rollout packs, and performance decks for AI model evaluation.

Role involves designing tasks to probe AI in real-world workflows and collaborating with frontier teams to implement evaluated processes. Remote or in-office (Liverpool Street, London) options available, with compensation on task idea selection plus hourly evaluation design work.