Remote | Journalist/Writer — $90–$140/hour

24-Mag Llc; Northern, New York (KY, NY); Hybrid; USD 124,000 - 193,000; Full time

Benefits offered by this job

Fully remote work

Independent contractor engagement

Job summary

24-MAG LLC is seeking experienced Journalists/Writers to rigorously evaluate AI-generated content. You will assess clarity, tone, and alignment with briefs, while flagging factual or logical issues using professional editorial judgement.

Ideal candidates have a journalism or editing background, strong writing and critical analysis skills, and comfort working remotely on varied topics with strict deadlines. Compensation is competitive and remote-friendly.

Qualifications

• Native or near-native English writing ability.
• University degree from US/Canada/UK/Ireland/Australia or NZ.
• Professional background as journalist/editor/fact-checker.
• Experience in technical writing, evaluation or editorial review.
• Ability to follow style guides and provide accurate edits.
• Strong attention to detail and clear written communication.
• Comfortable working remotely and independently.
• Experience with annotation or AI-model evaluation is a plus.

Responsibilities

• Assess AI-generated writing for clarity, accuracy and adherence to instructions.
• Provide concise rationales grounded in editorial judgement.
• Identify factual or logical weaknesses and document findings.
• Score content quality and provide structured feedback.
• Collaborate asynchronously with project managers and reviewers.

Skills

Editorial judgment

English fluency

Journalism background

Copy editing

Critical analysis

Education

University degree

Tools

Annotation platforms

AI evaluation tools

Job description

We are sharing a specialised consulting opportunity for experienced Journalist/Writers with strong expertise in journalism, editing, fact-checking, technical writing, content evaluation, and critical analysis to contribute to an advanced AI training and written-content evaluation project.

Selected professionals will assess AI-generated writing, compare responses for clarity and accuracy, identify factual or logical weaknesses, and provide concise written rationales grounded in professional editorial judgement. No prior experience in AI is required.

Key Responsibilities

Written Content Evaluation

• Evaluate and compare multiple AI-generated responses to writing prompts
• Assess clarity, tone, helpfulness, relevance, and adherence to instructions
• Determine whether responses address the intended brief effectively
• Evaluate writing for audience suitability and communication quality
• Apply consistent editorial judgement across repeated review tasks

Fact-Checking & Accuracy Review

• Identify factual inaccuracies, unsupported claims, and misleading statements
• Detect writing that appears persuasive but lacks sufficient support
• Review content for internal consistency and logical coherence
• Flag errors that could affect reliability or reader understanding
• Apply professional fact-checking standards to complex written material

Editorial & Critical Analysis

• Assess structure, argument quality, precision, and overall effectiveness
• Identify weaknesses in reasoning, framing, or evidence
• Evaluate whether writing is clear, concise, and appropriately qualified
• Apply editorial standards when reviewing tone and message delivery
• Distinguish strong writing from polished but substantively weak content

Scoring & Written Rationale

• Assign analytical quality scores using project-provided criteria
• Produce concise written rationales explaining evaluation decisions
• Document strengths, weaknesses, and significant issues clearlyMaintain consistency across scoring and comparative assessments
• Record evaluations thoroughly using digital review platforms and project tools

Remote Review & Collaboration

• Collaborate asynchronously with project managers and reviewers
• Support consistent interpretation of evaluation standards across the project
• Work independently while managing assigned deliverables and deadlines
• Use digital content-review platforms to complete and document evaluations
• Contribute professional editorial judgement to AI training and evaluation workflows

Ideal Profile

• Native or near-native written fluency in English
• University degree completed at an institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand
• Professional background as a journalist, reporter, editor, copy editor, sub-editor, fact-checker, ghostwriter, or published author
• Strong experience in technical writing, content evaluation, critical analysis, or editorial review
• Demonstrated experience editing or fact-checking work against a style guide or editorial standards
• Excellent written communication and editing skills
• Strong ability to assess writing for accuracy, clarity, and audience suitability
• Exceptional attention to detail and analytical judgement
• Comfortable evaluating competing written responses objectively
• Able to identify factual, logical, and structural weaknesses in written content
• Comfortable working independently in a remote environment
• Experience with annotation, AI model evaluation, or digital content-review platforms is advantageous but not required

Engagement Details

• Independent contractor engagement
• Fully remote
• Compensation: $90–$140/hour
• Work will involve written-response evaluation, comparative review, fact-checking, analytical scoring, editing, and written assessment rationale
• Assignments may involve varied topics, writing styles, audiences, and content formats
• Strong editorial judgement, factual accuracy, and attention to detail are central to this engagement
• Collaboration will primarily be asynchronous through digital review and project-management platforms
• Project scope, workload, evaluation criteria, and review standards may evolve depending on project requirements
• Work must be completed without using confidential or proprietary information belonging to any employer, client, publisher, institution, or other third party

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.