Generalist Specialist (Remote | $50–$70/hr)

Synthires; Austin (TX); Remote; USD 80,000 - 113,000; Part time

Benefits offered by this job

Competitive pay

Flexible projects

Job summary

Synthires is seeking strong analytical thinkers to evaluate AI-generated responses and provide detailed feedback to improve the performance of next-generation AI systems. You will assess quality and reasoning and work independently in a remote setting.

The role emphasizes clear, well-supported rationales, rigorous evaluation, and adherence to established guidelines. Flexible, project-based work with competitive compensation is offered.

Qualifications

• Bachelor's degree from a globally recognized university; top-500 preferred.
• Strong analytical, critical-thinking, and written communication skills.
• Ability to work independently and follow detailed evaluation guidelines.
• Strong ability to understand complex information and make well-reasoned judgments.

Responsibilities

• Evaluate AI-generated responses for quality and reasoning.
• Provide structured, detailed written feedback to improve AI systems.

Skills

Analytical thinking

Critical thinking

Written communication

Independent work

Follow evaluation guidelines

Understand complex information

Attention to detail

Native English fluency

Education

Bachelor's degree

Job description

This opportunity is for strong analytical thinkers and experienced evaluators interested in contributing to advanced AI research and evaluation projects.

In this role, you'll evaluate AI-generated responses, assess their quality and reasoning, and provide structured, detailed written feedback that helps improve the performance of next-generation AI systems.

Basic Qualifications

• Bachelor's degree from a globally recognized university; a top-500 ranked institution is preferred.
• Strong analytical, critical-thinking, and written communication skills.
• Ability to work independently and consistently follow detailed evaluation guidelines.
• Strong ability to understand complex information and make well-reasoned judgments.

Required Skills

• Excellent critical reading skills, with the ability to identify nuance, implicit meaning, inconsistencies, and gaps in reasoning.
• Ability to write clear, precise, and well-supported rationales that go beyond surface-level observations.
• Strong judgment and intellectual honesty, including the ability to provide critical assessments when appropriate.
• Exceptional attention to detail and accuracy when applying structured evaluation criteria.
• Ability to maintain consistency across multiple evaluations and follow established standards carefully.
• Ability to work without AI writing tools when completing evaluation tasks.
• Native English fluency is required.
• Strong written English proficiency and the ability to communicate complex observations clearly.
• Ability to work independently in a remote environment.

Compensation

• Competitive compensation of $70/hour.
• Flexible, project-based work.