Remote Legal Writer & AI Evaluation Specialist

RemoteJobsOne; Chicago (IL); Remote; USD 124,000 - 193,000; Full time

Job summary

RemoteJobsOne in the United States seeks Lawyer/Legal Writer for a fully remote, contractor role evaluating AI-generated legal content. You will assess clarity, tone, and compliance, scoring responses and drafting rationales.

You bring a qualifying law degree and strong writing, editing, and analytical skills; no AI experience required. Independent work, strict deadlines, and attention to detail are essential.

Qualifications

• English as a first language or fully equivalent written fluency.
• Qualifying law degree from a university in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
• Demonstrated experience drafting briefs, motions, memoranda, legal opinions, or regulatory submissions.
• Background in reviewing, editing, or supervising legal writing by junior lawyers, trainees, or paralegals.
• Strong ability to assess whether content is tailored appropriately for legal, regulatory, client, or public audiences.
• Exceptional attention to detail, critical analysis, and written communication skills.
• Experience with digital document review platforms or annotation tools is desirable; familiarity with model evaluation or RLHF is a plus but not required.

Responsibilities

• Evaluate and compare multiple AI-generated written responses to legal and technical prompts for clarity, tone, and compliance with instructions.
• Assign analytical quality scores and compose detailed rationales for each assessment.
• Identify responses that sound authoritative but lack precision, contain overstatements, or present unsupported claims.
• Detect inconsistencies, ambiguities, or factual inaccuracies in digital content.
• Document findings and insights meticulously in online review platforms.
• Collaborate asynchronously with project managers and reviewers to ensure consistent evaluation standards.
• Work independently while managing deliverables and deadlines per project requirements.

Skills

English fluency

Written communication

Analytical thinking

Attention to detail

Independent work

Education

Law degree (J.D./LL.B.) from US/Canada/UK/Ireland/Australia/NZ

Tools

Annotation tools

Digital document review platforms

Job description

RemoteJobsOne in the United States seeks Lawyer/Legal Writer for a fully remote, contractor role evaluating AI-generated legal content. You will assess clarity, tone, and compliance, scoring responses and drafting rationales.

You bring a qualifying law degree and strong writing, editing, and analytical skills; no AI experience required. Independent work, strict deadlines, and attention to detail are essential.