Generalist Expert (Remote | $50–$70/hr)

Synthires; United States; Remote; USD 80,000 - 113,000; Full time

Job summary

Synthires is seeking evaluators to review AI-generated responses, judging quality and reasoning while maintaining high standards of accuracy. You will craft clear, well-supported rationales in a fully remote setting.

The role emphasizes independent work, strict adherence to evaluation guidelines, and native English proficiency. Compensation is hourly and project-based, offering flexible scheduling.

Qualifications

• Bachelor's degree from a globally recognized university; top-500 ranked institution preferred.
• Strong analytical, critical-thinking, and written communication skills.
• Ability to work independently and follow detailed evaluation guidelines.
• Strong ability to understand complex information and make well-reasoned judgments.

Responsibilities

• Evaluate AI-generated responses, assess quality and reasoning, and provide structured, detailed feedback.
• Contribute to improving performance of next-generation AI systems through clear, evidence-based assessments.

Skills

Analytical thinking

Critical reading

Written communication

Independent work

Remote work

English fluency

Education

Bachelor's degree

Job description

This opportunity is for strong analytical thinkers and experienced evaluators interested in contributing to advanced AI research and evaluation projects.

In this role, you'll evaluate AI-generated responses, assess their quality and reasoning, and provide structured, detailed written feedback that helps improve the performance of next-generation AI systems.

Basic Qualifications

• Bachelor's degree from a globally recognized university; a top-500 ranked institution is preferred.
• Strong analytical, critical-thinking, and written communication skills.
• Ability to work independently and consistently follow detailed evaluation guidelines.
• Strong ability to understand complex information and make well-reasoned judgments.

Required Skills

• Excellent critical reading skills, with the ability to identify nuance, implicit meaning, inconsistencies, and gaps in reasoning.
• Ability to write clear, precise, and well-supported rationales that go beyond surface-level observations.
• Strong judgment and intellectual honesty, including the ability to provide critical assessments when appropriate.
• Exceptional attention to detail and accuracy when applying structured evaluation criteria.
• Ability to maintain consistency across multiple evaluations and follow established standards carefully.
• Ability to work without AI writing tools when completing evaluation tasks.
• Native English fluency is required.
• Strong written English proficiency and the ability to communicate complex observations clearly.
• Ability to work independently in a remote environment.

Compensation

• Competitive compensation of $70/hour.
• Flexible, project-based work.