AI Evaluation Consultant — Former Management Consultants (Remote)

Synthires

California

Remote

USD 207,000 - 482,000

Full time

3 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote project-based work

Exposure to top-tier consulting

Job summary

Synthires is seeking former management consultants in the United States (California) for high-impact AI training and evaluation projects. You will apply your consulting toolkit, structured problem-solving approach, business analysis, and strong written communication to judge how AI models reason through business problems and improve performance.

No prior AI experience required. Requirements include at least 1 year at a top firm (McKinsey, Bain, BCG, Strategy&, L.E.K., Oliver Wyman) and recent

Qualifications

At least 1 year of experience at a top management consulting firm.
Experience with McKinsey, Bain, BCG, Strategy&, L.E.K., Oliver Wyman or similar.
Recent consulting experience within the past 7 years.
Strong capabilities in business strategy, structured problem solving, and business analysis.
Excellent written English and business communication skills.
Strong analytical ability and attention to reasoning quality and business logic.

Responsibilities

Evaluate AI model responses to business strategy and consulting-style problems.
Develop prompts, model answers, and detailed feedback.
Apply structured business and consulting frameworks to assess reasoning quality.
Analyze complex business scenarios using structured problem solving and business analysis.
Apply expertise in market research, financial analysis, and stakeholder considerations.
Collaborate with the project team as evaluation guidelines and requirements evolve.
Provide clear, rigorous written feedback to support continuous improvement of AI systems.