AI Response Auditor - Remote & Flexible Hours

Mosaec; California (MO); Hybrid; USD 34,000 - 62,000; Part time

Benefits offered by this job

Fully remote

Flexible hours

Independent contractor engagement

Job summary

iMerit is seeking detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.

This independent contractor role is fully remote with flexible hours; you will review images and model outputs, contrast them, score quality, and provide written explanations to guide improvements across

Qualifications

• Strong critical thinking and sound judgment in ambiguous cases.
• Solid research skills and attention to detail.
• Excellent reading comprehension.
• Self direction and the discipline to hit deadlines without supervision.

Responsibilities

• Interpret conversational context and identify what the user really wanted.
• Rate and rank responses against defined quality criteria.
• Explain in writing why one response is preferred over others.
• Verify factual claims using approved research sources.
• Flag tasks that cannot be reliably assessed rather than guessing.

Skills

Critical thinking

Judgment in ambiguity

Research skills

Attention to detail

Reading comprehension

Self-directed

Deadline awareness

Job description

iMerit is seeking detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.

This independent contractor role is fully remote with flexible hours; you will review images and model outputs, contrast them, score quality, and provide written explanations to guide improvements across