AI Evaluation Consultant — Remote, Project-Based

Synthires

New York (NY)

Remote

USD 207,000 - 482,000

Full time

13 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work

Competitive hourly compensation

Job summary

Synthires in the United States is seeking former management consultants to contribute to high-impact AI training and evaluation projects. You will apply your consulting toolkit, structured problem-solving approach, business analysis skills, and written communication to assess AI model reasoning on complex business problems and help improve performance toward expert levels.

No prior AI experience is required—your consulting expertise and ability to solve complex problems are what matter.

Qualifications

Experience at a top management consulting firm in the past seven years.
Strong capabilities in business strategy and structured problem solving.
Excellent written English and business communication skills.
Analytical ability focused on reasoning quality and business logic.

Responsibilities

Evaluate AI model responses to business strategy and consulting-style problems.
Develop prompts, model answers, and detailed feedback.
Apply structured business frameworks to assess reasoning quality.
Analyze complex business scenarios using structured problem solving and business analysis.
Apply market research, financial analysis, and stakeholder considerations where relevant.
Collaborate as evaluation guidelines evolve.
Provide clear, rigorous written feedback to support AI system improvement.