Urdu AI Quality Evaluator (Contract)

Obsidian; Karachi Division; Remote; PKR 8,340,283 - 13,900,472; Part time

Job summary

Obsidian is seeking a qualified professional to assess AI-generated responses in Urdu, providing detailed evaluations in English. The ideal candidate will hold a Bachelor's degree and possess native fluency in Urdu with strong writing skills in English. Responsibilities include fact-checking and generating high-quality evaluation data to improve responses.

This contract work requires significant experience with large language models and strong analytical thinking skills.

Qualifications

• Bachelor's degree is required.
• Native fluency in Urdu is mandatory.
• Strong proficiency in English is required for feedback articulation.

Responsibilities

• Conduct fact-checking using trusted public sources.
• Generate evaluation data by assessing response strengths.
• Ensure model responses align with expected conversation behavior.

Skills

Fluent in Urdu

Strong writing skills in English

Experience with large language models

Attention to detail

Education

Bachelor's degree

Job description

Obsidian is seeking a qualified professional to assess AI-generated responses in Urdu, providing detailed evaluations in English. The ideal candidate will hold a Bachelor's degree and possess native fluency in Urdu with strong writing skills in English. Responsibilities include fact-checking and generating high-quality evaluation data to improve responses.

This contract work requires significant experience with large language models and strong analytical thinking skills.