Legal AI Evaluation Expert

OpenTrain AI, Inc.; United States; Remote; USD 2,066,000 - 3,444,000; Part time

Job summary

OpenTrain AI, Inc. seeks an entry-level, part-time contractor to help train AI systems by reviewing legal responses and expert solutions. You will judge whether outputs follow project guidelines, explain your decisions, and provide feedback to improve model behavior.

Responsibilities include writing or improving expert responses, reviewing materials and AI outputs against rubrics, and applying consistent evaluation across tasks while working independently from a remote setting.

Qualifications

• Fluency in English.
• Strong writing and attention to detail.
• Ability to follow detailed instructions and apply rubrics.
• Experience evaluating legal AI responses is preferred.

Responsibilities

• Write or improve expert legal responses.
• Review materials and AI outputs against guidelines.
• Explain judgments clearly in feedback.
• Apply evaluation rubrics consistently.
• Maintain quality and consistency while working independently.

Skills

Strong writing

Attention to detail

Follow rubrics

English fluency

Education

Relevant professional, academic, or language expertise in Legal AI Response Evaluation

Job description

The Work

You will help train AI systems by reviewing legal responses and expert solutions. You will judge whether outputs follow project guidelines, explain your decisions, and provide clear feedback that can improve model behavior.

The work also includes writing or improving expert responses and keeping your reviews consistent across repeated tasks.

• Write or improve expert legal responses.
• Review source materials and AI-generated outputs against project guidelines.
• Explain your judgments clearly in written feedback.
• Apply evaluation rubrics consistently across tasks.
• Maintain careful quality and consistency while working independently.

What It Pays and Takes

The project budget fields on this listing contain the compensation details. The role is a part-time contractor position and is listed as entry level, although it requires relevant legal expertise and strong written judgment.

• Compensation: Listed through the OpenTrain project budget fields; no rate is provided here.
• Schedule: At least 4 hours per day, up to 40 hours per week.
• Time requirement: 20 or more hours per week.
• Availability: 4 hours of overlap with Pacific Standard Time each day.
• Location: Worldwide and remote.
• Language: Fluency in English.
• Experience: Relevant professional, academic, or language expertise in Legal AI Response Evaluation.
• Skills: Strong writing, close attention to detail, and the ability to follow detailed instructions and apply rubrics.
• Work style: Comfortable working independently on remote contractor tasks.

About AI Training Work

AI training work uses human-written examples, reviews, and feedback to help artificial intelligence produce better results. Legal experts are paid for this work because careful subject knowledge and consistent judgment help make AI responses more accurate and useful.