Remote AI Consulting Quality Evaluator

Weekday 1; United States; Remote; USD 207,000 - 303,000; Full time

Benefits offered by this job

Job summary

Weekday 1 is seeking experienced Management Consulting Experts to contribute their expertise in evaluating and improving next-generation AI systems. You will define quality standards, create evaluation frameworks, and review consulting deliverables with expert judgment in a fully remote, asynchronous setup.

The role focuses on designing objective grading criteria, evaluating both AI-generated and human-created outputs across various business scenarios, and providing evidence-based justifications

Qualifications

• 5+ years of professional experience in management consulting or corporate strategy.
• Experience at a leading strategy or management consulting firm (e.g., McKinsey & Company, Bain & Company, Boston Consulting Group).
• Deep expertise in structured problem-solving, market sizing, financial modeling, corporate strategy, and executive-level presentations.

Responsibilities

• Develop detailed, task-specific evaluation criteria for consulting deliverables across market analyses, business strategies, financial models, executive presentations, and roadmaps.
• Review and score AI-generated and human-created consulting work using structured evaluation frameworks and objective quality standards.
• Provide clear, evidence-based written justifications for every evaluation, ensuring consistency, transparency, and reproducibility.
• Assess quality of strategic thinking, analytical rigor, financial reasoning, executive communication, and business recommendations.
• Collaborate with review teams to refine evaluation guidelines and improve scoring calibration.
• Incorporate structured feedback from senior reviewers to continuously improve evaluation quality and calibration.
• Apply subject matter expertise to help AI systems generate higher-quality consulting outputs.

Skills

Management consulting

Structured problem solving

Market sizing

Financial modeling

Corporate strategy

Executive presentations

Written communication

Analytical thinking

Remote work

Job description

Weekday 1 is seeking experienced Management Consulting Experts to contribute their expertise in evaluating and improving next-generation AI systems. You will define quality standards, create evaluation frameworks, and review consulting deliverables with expert judgment in a fully remote, asynchronous setup.

The role focuses on designing objective grading criteria, evaluating both AI-generated and human-created outputs across various business scenarios, and providing evidence-based justifications