US-Licensed Attorney Evaluator

Vettedlance; United States; Remote; USD 138,000 - 220,000; Part time

Job summary

Vettedlance in the United States seeks US bar-admitted attorneys to evaluate AI legal reasoning and drafting, and to write rubrics and legal tasks used to train models.

You will write realistic legal research, analyze model answers, grade AI responses, and design evaluation rubrics, while flagging hallucinated authorities and unsafe legal advice. This remote, part-time hourly contract offers flexible 10–40 hours per week.

Qualifications

• Admitted to practise in at least one US state, in good standing.
• JD and 5+ years of practice.
• Excellent written English.

Responsibilities

• Write realistic legal research, analysis and drafting tasks with model answers.
• Grade AI answers for legal accuracy, citation quality and reasoning.
• Design rubrics for legal and compliance evaluations.
• Flag hallucinated authorities and unsafe legal advice.

Skills

Excellent written English

Education

JD

Job description

US bar-admitted attorneys evaluate AI legal reasoning and drafting, and write the rubrics and legal tasks used to train models.

What you will do

• Write realistic legal research, analysis and drafting tasks with model answers.


• Grade AI answers for legal accuracy, citation quality and reasoning.


• Design rubrics for legal and compliance evaluations.


• Flag hallucinated authorities and unsafe legal advice.

What you need

• Admitted to practise in at least one US state, in good standing.


• JD and 5+ years of practice.


• Excellent written English.

Contract

• Remote, hourly contract (independent contractor)


• Part-time, flexible: 10-40 hrs/week


• Remote US time zones preferred (applicants must be in the United States)

Pay: $100 - $160 / hour (USD). Paid in USD, weekly. Rate set after a short paid assessment.