Language Model Analyst - Fully Remote | Upto $20/hr Part-time

mercor; India; A distancia; INR 2.002.000 - 2.670.000; A tiempo parcial

Descripción de la vacante

Mercor seeks a Generalist fluent in English and Odia for a remote, contract position. You will conduct fact-checking, evaluate responses, and help improve AI system guidance by creating high-quality evaluation data.

Requirements include a Bachelor's degree, native Odia, strong English writing and attention to detail, plus experience with LLMs. RLHF or data annotation background is a plus.

Formación

• Bachelor's degree required.
• Native Odia speaker.
• Significant experience with large language models (LLMs).
• Excellent writing skills in English.
• Strong attention to detail.
• Background in domains requiring structured analytical thinking.

Responsabilidades

• Conduct fact-checking using trusted public sources and external tools.
• Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
• Assess reasoning quality, clarity, tone, and completeness of responses.
• Ensure model responses align with expected conversational behavior and system guidelines.

Conocimientos

Attention to detail

English writing

Analytical thinking

Native Odia speaker

Educación

Bachelor's degree

Herramientas

LLMs

RLHF experience

Descripción del empleo

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Generalist - English & Odia Type: Contract Compensation: $15–$20/hour Location: Remote

Responsibilities

• Conduct fact-checking using trusted public sources and external tools .


• Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.


• Assess reasoning quality, clarity, tone, and completeness of responses.


• Ensure model responses align with expected conversational behavior and system guidelines.

Qualifications Must-Have

• Bachelor's degree .


• Native speaker in Odia .


• Significant experience using large language models (LLMs).


• Excellent writing skills in English .


• Strong attention to detail .


• Background or experience in domains requiring structured analytical thinking .

Preferred

• Prior experience with RLHF, model evaluation, or data annotation work .


• Experience writing or editing high-quality written content .


• Experience comparing multiple outputs and making fine-grained qualitative judgments .

Application Process (Takes 20–30 mins to complete)

• Upload resume


• AI interview based on your resume


• Submit form

Resources & Support

• For details about the interview process and platform information, please check:


• For any help or support, reach out to: