Remote Legal AI Annotator & LLM Evaluation Specialist

Lemon Recruitment; Kuala Lumpur; Remote; MYR 338,000 - 563,000; Part time

Job summary

Lemon Recruitment seeks a contractor for a remote role to review AI/LLM-generated content in the legal domain. You will evaluate and improve content related to law and legal reasoning, and develop robust evaluation criteria.

Requirements include a law-related degree or equivalent, 2+ years of professional legal experience, strong legal vocabulary, and excellent written communication with attention to detail. Familiarity with AI/LLMs or data annotation is preferred.

Qualifications

• Degree or professional background in Law, Legal Studies, or a related field.
• 2+ years of professional legal experience in practice, research, or contracts.
• Strong legal vocabulary and analytical reasoning.

Responsibilities

• Review, evaluate, and improve AI/LLM-generated content related to law and legal reasoning.
• Create and validate high-quality legal prompts, responses, scenarios, and evaluation criteria.
• Assess AI outputs for legal accuracy, reasoning quality, relevance, and consistency.
• Identify errors, ambiguities, and potential legal risks in AI-generated content.

Skills

Legal knowledge

Analytical reasoning

Attention to detail

Written communication

AI/LLMs familiarity

Education

Law-related degree or equivalent

Job description

Lemon Recruitment seeks a contractor for a remote role to review AI/LLM-generated content in the legal domain. You will evaluate and improve content related to law and legal reasoning, and develop robust evaluation criteria.

Requirements include a law-related degree or equivalent, 2+ years of professional legal experience, strong legal vocabulary, and excellent written communication with attention to detail. Familiarity with AI/LLMs or data annotation is preferred.