AI Evaluation Strategy Consultant (Remote)

Synthires

United States

Remote

USD 207,000 - 482,000

Full time

16 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Synthires is seeking former management consultants for high-impact AI training and evaluation projects. You’ll apply consulting toolkit, structured problem solving, business analysis, and written communication to evaluate how AI models reason through business problems and improve performance toward expert level.

No prior AI experience required; your consulting expertise and ability to solve complex business problems are what matter.

Qualifications

At least 1 year of experience at a top management consulting firm (McKinsey, Bain, BCG, Strategy&, L.E.K., Oliver Wyman)
Experience within the past 7 years in a consulting role
Strong capabilities in business strategy, problem solving, and business analysis
Excellent written English and business communication skills
Strong analytical ability and attention to reasoning quality and business logic

Responsibilities

Evaluate AI model responses to business strategy and consulting-style problems
Develop prompts, model answers, and detailed feedback
Apply structured consulting frameworks to assess reasoning quality and identify gaps
Analyze complex business scenarios using structured problem solving and business analysis
Apply market research, financial analysis, and stakeholder considerations where relevant
Collaborate with the project team as evaluation guidelines evolve
Provide clear, rigorous written feedback to support AI system improvement