RLHF Preference Annotator

Corpshore AI; Manila; Remote; PHP 605,000 - 1,211,000; Part time

Job summary

Corpshore AI seeks a detail-oriented contractor in the Philippines to improve AI alignment tasks. You will compare and rank model outputs against rubrics, write clear rationales, and participate in calibration rounds from a remote setup.

The role is remote, English-speaking, with compensation of $7–$14 per hour, and requires analytical reasoning and a bachelor’s degree or equivalent experience. This is a paid assessment-driven position.

Qualifications

• Analytical reasoning and problem-solving abilities.
• Bachelor's degree or equivalent experience preferred.

Responsibilities

• Rank model responses to a rubric.
• Write rationales for preferences.
• Participate in calibration rounds.

Skills

Analytical reasoning

Education

Bachelor's degree or equivalent experience

Job description

Compare and rank model outputs against a rubric to produce preference data for LLM alignment.

Philippines · Remote Remote / Contract English $7–$14/hr (indicative)

What you'll do

• Rank model responses to a rubric
• Write rationale for preferences
• Participate in calibration rounds

What we look for

• Analytical reasoning
• Bachelor's degree or equivalent experience preferred

Before you apply: the assessment

After applying you'll complete a short, paid-style skills assessment relevant to this role, so you know exactly what the work involves before committing.