Remote AI Evaluation Consultant - Management Consulting Pro

Synthires; New York (NY); Remote; USD 338,000 - 386,000; Full time

Benefits offered by this job

Remote work

Competitive hourly pay

Top-tier consulting experience

Job summary

Synthires is partnering with a leading AI lab to engage former management consultants for high-impact AI training and evaluation projects. No prior AI experience is required—your consulting expertise and ability to solve complex business problems are what matter.

In this role, you'll apply consulting toolkit, structured problem-solving, and business analysis to evaluate how AI models reason and to help improve performance toward expert level.

Qualifications

• Experience at a top management consulting firm (e.g., McKinsey, Bain, BCG, Strategy&, L.E.K., Oliver Wyman)
• Experience within the past 7 years in consulting
• Strong capabilities in business strategy, problem solving, and analysis
• Excellent written English and business communication
• Strong analytical ability and emphasis on reasoning quality

Responsibilities

• Evaluate AI model responses to business strategy problems
• Develop high-quality prompts, model answers, and detailed feedback
• Apply structured business and consulting frameworks to assess reasoning quality
• Analyze complex business scenarios using structured problem solving and analysis
• Apply market research, financial analysis, and stakeholder considerations where relevant
• Collaborate with the project team as evaluation guidelines evolve
• Provide clear, rigorous written feedback to support AI improvements

Skills

Business strategy

Structured problem solving

Business analysis

Written English

Reasoning quality

Education

Undergraduate degree

Job description

Synthires is partnering with a leading AI lab to engage former management consultants for high-impact AI training and evaluation projects. No prior AI experience is required—your consulting expertise and ability to solve complex business problems are what matter.

In this role, you'll apply consulting toolkit, structured problem-solving, and business analysis to evaluate how AI models reason and to help improve performance toward expert level.