AI Output Quality Auditor (Remote, Part-Time)

Akraya; San Francisco (CA); Remote; USD 62,000 - 69,000; Part time

Job summary

AKRAYA is seeking a part-time remote data and content evaluator to meticulously review AI-generated data narratives for accuracy and clarity. You will assess charts, headlines, and conversational outputs against a defined quality rubric, identifying subtle errors that automated systems might miss.

The role emphasizes strong analytical skills, editorial judgment, and precise written communication to help improve AI-driven data storytelling.

Qualifications

• Strong analytical skills for data interpretation.
• Excellent attention to detail for editorial review.
• Proficiency in clear and concise written communication.

Responsibilities

• Evaluate AI-generated content against a specific quality rubric.
• Assess the accuracy and appropriateness of data visualizations and claims.
• Identify and report misleading information or awkward phrasing in AI output.
• Document evaluation findings and provide concise reports to the team.
• Propose enhancements to the evaluation rubric based on observed trends.

Skills

Data analysis

Data visualization

Editorial judgment

Written reporting

LLM evaluation

Job description

AKRAYA is seeking a part-time remote data and content evaluator to meticulously review AI-generated data narratives for accuracy and clarity. You will assess charts, headlines, and conversational outputs against a defined quality rubric, identifying subtle errors that automated systems might miss.

The role emphasizes strong analytical skills, editorial judgment, and precise written communication to help improve AI-driven data storytelling.