Remote AI Legal Writing Evaluator (Contractor)

24 MAG LLC; United States; Remote; USD 124,000 - 193,000; Part time

Job summary

24 MAG LLC is offering a fully remote, independent contractor role for experienced Lawyer/Legal Writers to evaluate AI-generated legal content. You will assess clarity, precision, and audience suitability, and provide structured written rationales grounded in professional legal judgment.

Ideal candidates hold a qualifying law degree and have demonstrated experience drafting and editing legal materials, with strong attention to detail and independent work capabilities.

Qualifications

• English: native or fully fluent writing.
• Qualifying law degree from a US/Canada/UK/Ireland/Australia/NZ institution.
• Experience drafting briefs, motions, memoranda, opinions, or regulatory submissions.
• Experience reviewing, editing, or supervising legal writing by junior lawyers, trainees, or paralegals.
• Strong legal-writing, document-review, and content-evaluation skills.
• Ability to assess writing for different audiences and purposes.
• Excellent attention to detail and critical-analysis ability.
• Familiarity with model evaluation or RLHF is advantageous.

Responsibilities

• Assess AI-generated legal and technical writing for clarity, tone, precision, and completeness.
• Evaluate whether responses are appropriately qualified for the subject matter and audience.
• Apply rubric-based evaluation criteria and assign analytical quality scores.
• Produce detailed written rationales explaining assessment decisions.
• Collaborate asynchronously with project managers and reviewers and maintain records of scoring decisions.
• Work independently to meet deadlines with high quality outputs.

Skills

Legal writing

Document review

Critical analysis

Editing

Written communication

Attention to detail

Independent work

Education

Law degree (US/Canada/UK/Ireland/Australia/NZ)

Tools

Annotation tools

Digital review platforms

Job description

24 MAG LLC is offering a fully remote, independent contractor role for experienced Lawyer/Legal Writers to evaluate AI-generated legal content. You will assess clarity, precision, and audience suitability, and provide structured written rationales grounded in professional legal judgment.

Ideal candidates hold a qualifying law degree and have demonstrated experience drafting and editing legal materials, with strong attention to detail and independent work capabilities.