Remote Legal AI Task Designer & Evaluator

Sovrano AI; United States; Remote; USD 55,000 - 172,000; Part time

Benefits offered by this job

PayPal payments

Job summary

Sovrano AI seeks experienced legal professionals for a fully remote, project-based role focused on evaluating frontier AI-generated legal work. You’ll create tasks from your own practice, test them against frontier models, and judge results as a professional reviewer.

You set your own schedule, with a minimum of 10 hours per week. Pay ranges from $40 to $125 per hour, and payments are processed via PayPal to independent contractors in the listed countries.

Qualifications

• Based in the United States, United Kingdom, Ireland, Canada, or Australia.
• Bachelor's degree or higher; law degree preferred.
• 2+ years of legal experience preferred.
• Available at least 10 hours per week.
• PayPal account for payment.
• Willing to work without LLM assistance where the project does not permit it.
• Use one email address to sign up, take the assessment, and get paid.

Responsibilities

• Build realistic tasks out of problems from your own legal work, along with the material needed to solve them.
• Give those tasks to frontier AI models and judge the results against the standard of your profession.
• Weigh paired model answers against each other and explain which one holds up.
• Write grading rubrics for your tasks and set out your reasoning in writing.
• Review and improve tasks written by other experts.

Skills

Legal research

Contract drafting

Legal writing

Compliance

Due diligence

Rubric writing

Education

Bachelor's degree or higher

Law degree preferred

Job description

Sovrano AI seeks experienced legal professionals for a fully remote, project-based role focused on evaluating frontier AI-generated legal work. You’ll create tasks from your own practice, test them against frontier models, and judge results as a professional reviewer.

You set your own schedule, with a minimum of 10 hours per week. Pay ranges from $40 to $125 per hour, and payments are processed via PayPal to independent contractors in the listed countries.