AI Workflow Evaluator — Part-Time, Remote

24-Mag Llc; Northern (KY); Hybrid; USD 41,000 - 124,000; Part time

Job summary

24-MAG LLC is offering a specialised part-time consulting opportunity for experienced professionals who use AI assistants like ChatGPT and Claude in real-world business workflows to contribute to an advanced AI training and evaluation project.

Selected candidates will run complex, multi-step business scenarios, evaluate AI outputs, document results, and provide structured feedback to support improvements in AI systems. The role is fully remote and contract-based, with flexible timing.

Qualifications

• Minimum of 5 years in a technology-enabled business role.
• Bachelor's degree or higher required.
• Proficient in ChatGPT/Claude for professional work.
• Experience with evaluation rubrics or QA scoring.
• Excellent written English and documentation skills.
• Ability to work independently in remote, asynchronous settings.

Responsibilities

• Run multi-step professional scenarios with AI assistants.
• Recreate realistic business workflows across analysis, communication, documentation, research, and operations.
• Assess AI performance across workflow stages and provide actionable evaluations.
• Document quality issues and model-performance patterns.
• Provide clear, constructive feedback and maintain transparent records.

Job description

24-MAG LLC is offering a specialised part-time consulting opportunity for experienced professionals who use AI assistants like ChatGPT and Claude in real-world business workflows to contribute to an advanced AI training and evaluation project.

Selected candidates will run complex, multi-step business scenarios, evaluate AI outputs, document results, and provide structured feedback to support improvements in AI systems. The role is fully remote and contract-based, with flexible timing.