Remote - Lawyer

24 MAG LLC; United States; Remote; USD 124,000 - 193,000; Part time

Job summary

24 MAG LLC is offering a fully remote, independent contractor role for experienced Lawyer/Legal Writers to evaluate AI-generated legal content. You will assess clarity, precision, and audience suitability, and provide structured written rationales grounded in professional legal judgment.

Ideal candidates hold a qualifying law degree and have demonstrated experience drafting and editing legal materials, with strong attention to detail and independent work capabilities.

Qualifications

• English: native or fully fluent writing.
• Qualifying law degree from a US/Canada/UK/Ireland/Australia/NZ institution.
• Experience drafting briefs, motions, memoranda, opinions, or regulatory submissions.
• Experience reviewing, editing, or supervising legal writing by junior lawyers, trainees, or paralegals.
• Strong legal-writing, document-review, and content-evaluation skills.
• Ability to assess writing for different audiences and purposes.
• Excellent attention to detail and critical-analysis ability.
• Familiarity with model evaluation or RLHF is advantageous.

Responsibilities

• Assess AI-generated legal and technical writing for clarity, tone, precision, and completeness.
• Evaluate whether responses are appropriately qualified for the subject matter and audience.
• Apply rubric-based evaluation criteria and assign analytical quality scores.
• Produce detailed written rationales explaining assessment decisions.
• Collaborate asynchronously with project managers and reviewers and maintain records of scoring decisions.
• Work independently to meet deadlines with high quality outputs.

Skills

Legal writing

Document review

Critical analysis

Editing

Written communication

Attention to detail

Independent work

Education

Law degree (US/Canada/UK/Ireland/Australia/NZ)

Tools

Annotation tools

Digital review platforms

Job description

We are sharing a specialised consulting opportunity for experienced Lawyer/Legal Writers with strong expertise in legal writing, document review, critical analysis, content evaluation, editing, and written legal communication to contribute to an advanced AI training and legal-content evaluation project.

Selected professionals will assess AI-generated legal and technical writing, evaluate precision and audience suitability, identify unsupported or overstated claims, and provide structured written rationales grounded in professional legal judgement. This is an evaluative engagement focused on written content rather than legal advice or representation. No prior experience in AI is required.

Key Responsibilities

Legal Content Evaluation

• Evaluate and compare AI-generated responses to legal and technical prompts
• Assess clarity, tone, precision, completeness, and adherence to instructions
• Determine whether content is appropriately qualified for the subject matter
• Evaluate whether responses are suitable for legal, regulatory, client, or public audiences
• Apply consistent professional judgement across repeated evaluation tasks

Legal Reasoning & Accuracy Review

• Identify unsupported claims, unwarranted overstatements, and weak legal reasoning
• Detect factual inaccuracies, ambiguities, and internal inconsistencies
• Assess whether authoritative-sounding content is adequately supported
• Review arguments for logical coherence and appropriate qualification
• Flag issues that could affect reliability, usability, or interpretation

Rubric-Based Assessment & Scoring

• Apply defined evaluation criteria and project guidelines consistently
• Assign analytical quality scores to written responses
• Compare competing outputs and distinguish stronger from weaker reasoning
• Evaluate responses against standards for accuracy, usefulness, and audience fit
• Maintain objective and repeatable assessment practices across assignments

Written Rationale & Documentation

• Produce detailed written rationales explaining assessment decisions
• Clearly articulate why particular responses are accurate, incomplete, or problematic
• Document findings and observations thoroughly in digital review platforms
• Maintain clear records of scoring and evaluation decisions
• Communicate complex legal-writing judgements concisely and professionally

Legal Writing Review & Collaboration

• Apply experience from drafting and reviewing briefs, motions, memoranda, opinions, or regulatory submissions
• Edit and assess written legal content for structure, clarity, and precision
• Collaborate asynchronously with project managers and reviewers
• Support consistent evaluation standards across project contributors
• Work independently while meeting assigned deadlines and quality expectations

Ideal Profile

• English as a first language or fully equivalent written fluency
• Qualifying law degree from a university in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand
• Demonstrated experience drafting briefs, motions, memoranda, legal opinions, regulatory submissions, or comparable legal materials
• Experience reviewing, editing, or supervising legal writing by junior lawyers, trainees, or paralegals
• Strong legal-writing, document-review, and content-evaluation skills
• Ability to assess whether writing is appropriately tailored for different audiences
• Exceptional attention to detail and critical-analysis ability
• Excellent written communication and editing skills
• Strong judgement around precision, qualification, and unsupported assertions
• Comfortable applying structured evaluation criteria and documenting decisions
• Experience with digital document-review platforms or annotation tools is desirable
• Familiarity with model evaluation, RLHF, or similar workflows is advantageous but not required

Engagement Details

• Independent contractor engagement
• Fully remote
• Compensation: $90-$140/hour
• Work will involve legal-content evaluation, comparative response review, analytical scoring, editing, and written assessment rationale
• This engagement focuses on evaluating written legal content and does not involve providing legal advice or representation
• No attorney-client relationship is created through project participation
• Assignments may involve legal, regulatory, technical, client-facing, or public-facing written materials
• Collaboration will primarily be asynchronous through digital review and project-management platforms
• Strong legal judgement, written precision, and consistency are central to this engagement
• Project scope, workload, evaluation criteria, and review standards may evolve depending on project requirements
• Work must be completed without using confidential or proprietary information belonging to any employer, client, law firm, institution, or other third party

About the Platform

• This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.