Contract: Malayalam–English AI Evaluator & Feedback Specialist

Obsidian; New York (NY); On-site; USD 40,000 - 70,000; Part time

Job summary

Obsidian is seeking an individual to assess AI-generated responses in Malayalam, identifying strengths and areas for improvement. The role requires native fluency in Malayalam and strong English writing skills, ensuring evaluated responses align with expected behavior.

You will conduct fact-checking and generate high-quality assessment data. Ideal candidates hold a Bachelor's degree and have significant experience with large language models, alongside structured analytical skills.

Qualifications

• Native speaker of Malayalam with strong proficiency in English.
• Significant experience using large language models.
• Excellent writing skills to articulate nuanced feedback.

Responsibilities

• Conduct fact-checking using public sources and external tools.
• Generate high-quality evaluation data by assessing response strengths and weaknesses.
• Evaluate reasoning quality, clarity, tone, and alignment with guidelines.

Skills

Fluent in Malayalam

Proficient in English

Attention to detail

Structured analytical thinking

Education

Bachelor’s degree

Job description

Obsidian is seeking an individual to assess AI-generated responses in Malayalam, identifying strengths and areas for improvement. The role requires native fluency in Malayalam and strong English writing skills, ensuring evaluated responses align with expected behavior.

You will conduct fact-checking and generate high-quality assessment data. Ideal candidates hold a Bachelor's degree and have significant experience with large language models, alongside structured analytical skills.