Remote AI Content Evaluator & Editorial Analyst

24-Mag Llc; Northern, New York (KY, NY); Hybrid; USD 124,000 - 193,000; Full time

Benefits offered by this job

Fully remote work

Independent contractor engagement

Job summary

24-MAG LLC is seeking experienced Journalists/Writers to rigorously evaluate AI-generated content. You will assess clarity, tone, and alignment with briefs, while flagging factual or logical issues using professional editorial judgement.

Ideal candidates have a journalism or editing background, strong writing and critical analysis skills, and comfort working remotely on varied topics with strict deadlines. Compensation is competitive and remote-friendly.

Qualifications

• Native or near-native English writing ability.
• University degree from US/Canada/UK/Ireland/Australia or NZ.
• Professional background as journalist/editor/fact-checker.
• Experience in technical writing, evaluation or editorial review.
• Ability to follow style guides and provide accurate edits.
• Strong attention to detail and clear written communication.
• Comfortable working remotely and independently.
• Experience with annotation or AI-model evaluation is a plus.

Responsibilities

• Assess AI-generated writing for clarity, accuracy and adherence to instructions.
• Provide concise rationales grounded in editorial judgement.
• Identify factual or logical weaknesses and document findings.
• Score content quality and provide structured feedback.
• Collaborate asynchronously with project managers and reviewers.

Skills

Editorial judgment

English fluency

Journalism background

Copy editing

Critical analysis

Education

University degree

Tools

Annotation platforms

AI evaluation tools

Job description

24-MAG LLC is seeking experienced Journalists/Writers to rigorously evaluate AI-generated content. You will assess clarity, tone, and alignment with briefs, while flagging factual or logical issues using professional editorial judgement.

Ideal candidates have a journalism or editing background, strong writing and critical analysis skills, and comfort working remotely on varied topics with strict deadlines. Compensation is competitive and remote-friendly.