Generalist Specialist (Remote | $50–$70/hr)

Synthires; California; Remote; USD 80,000 - 113,000; Full time

Benefits offered by this job

Competitive pay

Remote, project-based work

Job summary

Synthires is seeking evaluators to join our AI research and evaluation team. You will assess AI-generated responses, judge quality and reasoning, and deliver structured, detailed written feedback to help improve next-generation AI systems.

Required skills include native English fluency, strong writing, critical reading, and meticulous attention to detail. This remote, project-based role offers flexible hours and competitive pay at $70/hour.

Qualifications

• Bachelor's degree from a globally recognized university (top-500 preferred).
• Strong analytical, critical-thinking, and written communication skills.
• Ability to work independently and follow detailed evaluation guidelines.
• Strong ability to understand complex information and make well-reasoned judgments.

Responsibilities

• Evaluate AI-generated responses, assess quality and reasoning.
• Provide structured, detailed written feedback to improve AI systems.
• Contribute to advanced AI research and evaluation projects.

Skills

Analytical thinking

Critical reading

Written communication

Attention to detail

Independent work

Follow evaluation guidelines

Judgment

Remote work

Native English fluency

English writing proficiency

Education

Bachelor's degree

Job description

This opportunity is for strong analytical thinkers and experienced evaluators interested in contributing to advanced AI research and evaluation projects.

In this role, you'll evaluate AI-generated responses, assess their quality and reasoning, and provide structured, detailed written feedback that helps improve the performance of next-generation AI systems.

Basic Qualifications

• Bachelor's degree from a globally recognized university; a top-500 ranked institution is preferred.
• Strong analytical, critical-thinking, and written communication skills.
• Ability to work independently and consistently follow detailed evaluation guidelines.
• Strong ability to understand complex information and make well-reasoned judgments.

Required Skills

• Excellent critical reading skills, with the ability to identify nuance, implicit meaning, inconsistencies, and gaps in reasoning.
• Ability to write clear, precise, and well-supported rationales that go beyond surface-level observations.
• Strong judgment and intellectual honesty, including the ability to provide critical assessments when appropriate.
• Exceptional attention to detail and accuracy when applying structured evaluation criteria.
• Ability to maintain consistency across multiple evaluations and follow established standards carefully.
• Ability to work without AI writing tools when completing evaluation tasks.
• Native English fluency is required.
• Strong written English proficiency and the ability to communicate complex observations clearly.
• Ability to work independently in a remote environment.

Compensation

• Competitive compensation of $70/hour.
• Flexible, project-based work.