AI Evaluation Consultant - Remote (Ex-Management Consultant)

Synthires

California

Remote

USD 207,000 - 482,000

Full time

31 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote-friendly projects

Top-tier consulting exposure

Job summary

Synthires, partnering with a leading AI lab, seeks former management consultants for high-impact AI training and evaluation projects. You will apply your consulting toolkit, structured problem-solving approach, business analysis skills, and written communication to evaluate how AI models reason through complex business problems and help improve their performance toward an expert level.

No prior AI experience is required — your consulting expertise and ability to solve complex business problems

Qualifications

At least 1 year of experience at a top management consulting firm (e.g., McKinsey, Bain, BCG, Strategy&, L.E.K., Oliver Wyman).
Experience within the past 7 years in a consulting role is preferred.
Strong capabilities in business strategy, structured problem solving, and business analysis.

Responsibilities

Evaluate AI model responses to business strategy problems.
Develop prompts, model answers, and detailed feedback.
Apply structured business and consulting frameworks to assess reasoning quality and identify gaps.
Analyze complex business scenarios using structured problem solving and business analysis.
Apply expertise in market research, financial analysis, and stakeholder considerations where relevant.
Collaborate with the project team as evaluation guidelines and requirements evolve.
Provide clear, rigorous written feedback to support AI system improvement.