AI Session Evaluator - Visual QA & Safety Feedback (Remote)

Recruitment Room; United States; Remoto; USD 50.000 - 62.000; Tempo pieno

Descrizione del lavoro

Appsierra Group is seeking an AI Session Annotator for a fully remote, independent contractor role. You will review recorded AI sessions, compare responses to visuals, and provide precise written feedback using a detailed rubric.

Strong English, attention to detail, and the ability to follow scoring rubrics are essential; an Android smartphone with camera and mic is required. Work is remote and flexible, with weekly payment.

Competenze

• Native or native-level English proficiency, spoken and written.
• Excellent written English and precise communication.
• Ability to follow a detailed evaluation rubric.

Mansioni

• Review recorded sessions where users interact with an AI assistant through voice and camera.
• Compare the assistant’s responses with the visual information actually available in the video.
• Identify fabricated, hallucinated, or inaccurate visual details.
• Evaluate each session for: visual interpretation, accuracy, relevance, response timing, and use of spatial language.
• Assess whether the assistant provides appropriate warnings when safety or health could be affected.
• Write detailed comments supporting each score with specific evidence from the session.
• Document conversations turn by turn using the intake form and apply the rubric consistently.

Conoscenze

Native English proficiency

Written English

Attention to detail

Analytical judgment

Follow evaluation rubric

Descrizione del lavoro

Appsierra Group is seeking an AI Session Annotator for a fully remote, independent contractor role. You will review recorded AI sessions, compare responses to visuals, and provide precise written feedback using a detailed rubric.

Strong English, attention to detail, and the ability to follow scoring rubrics are essential; an Android smartphone with camera and mic is required. Work is remote and flexible, with weekly payment.