Urdu LLM Evaluator - Global Contract Role

Obsidian; San Francisco (CA); Remote; USD 40,000 - 60,000; Part time

Job summary

Obsidian is seeking a Bilingual Evaluator to assess AI-generated responses in Urdu and English. Your role involves fact-checking and evaluating the quality of responses, providing essential feedback that will inform future AI development.

The ideal candidate will have a Bachelor's degree, be a native Urdu speaker, and possess strong English writing skills. This is a contract position that requires meticulous attention to detail and familiarity with large language models.

Qualifications

• Native speaker in Urdu with excellent English writing skills.
• Experience with large language models and structured analytical thinking.
• Ability to provide clear and nuanced feedback.

Responsibilities

• Conduct fact-checking using trusted public sources.
• Generate high-quality evaluation data for AI responses.
• Assess clarity, tone, and completeness of responses.

Skills

Urdu (native fluency)

English (strong proficiency)

Attention to detail

Experience using large language models

Analytical thinking

Education

Bachelor's degree

Job description

Obsidian is seeking a Bilingual Evaluator to assess AI-generated responses in Urdu and English. Your role involves fact-checking and evaluating the quality of responses, providing essential feedback that will inform future AI development.

The ideal candidate will have a Bachelor's degree, be a native Urdu speaker, and possess strong English writing skills. This is a contract position that requires meticulous attention to detail and familiarity with large language models.