Remote AI Evaluation Consultant — Top Consulting Skills

Synthires; California; Remote; USD 207,000 - 482,000; Full time

Job summary

Synthires is partnering with a leading AI lab to engage former management consultants for high-impact AI training and evaluation projects. In this role, you’ll apply your consulting toolkit and structured problem-solving approach to evaluate how AI models reason through business problems and help improve performance toward expert levels.

No prior AI experience is required—your consulting expertise and ability to solve complex business problems are what matter.

Qualifications

• 1+ year of experience at a top management consulting firm, within the past 7 years
• Strong capabilities in business strategy, structured problem solving, and business analysis
• Excellent written English and business communication skills
• Strong analytical ability and attention to reasoning quality and business logic

Responsibilities

• Evaluate AI model responses to business strategy and consulting-style problems.
• Develop prompts, model answers, and detailed feedback.
• Apply structured business and consulting frameworks to assess reasoning quality.
• Analyze complex business scenarios using structured problem solving and business analysis.
• Apply expertise in market research, financial analysis, and stakeholder considerations where relevant.
• Collaborate with the project team as evaluation guidelines and requirements evolve.
• Provide clear, rigorous written feedback to support continuous improvement of AI systems.

Skills

Consulting toolkit

Structured problem solving

Business analysis

Written English

Education

Undergraduate degree from a top-ranked university

Job description

Synthires is partnering with a leading AI lab to engage former management consultants for high-impact AI training and evaluation projects. In this role, you’ll apply your consulting toolkit and structured problem-solving approach to evaluate how AI models reason through business problems and help improve performance toward expert levels.

No prior AI experience is required—your consulting expertise and ability to solve complex business problems are what matter.