RAG Answer Quality Auditor

Globik AI; United States; Remoto; USD 21.000 - 28.000; Tempo pieno

Descrizione del lavoro

Globik AI is seeking RAG Answer Grounding Specialists to evaluate whether AI-generated answers are accurately supported by the documents or knowledge sources provided to the model. You will review AI answers alongside source material and identify unsupported claims, hallucinations, contradictions, and statements that go beyond the available evidence.

Responsibilities include reviewing answers with sources, checking evidence, and documenting grounding errors with evidence.

Competenze

• Experience with RAG search information retrieval, research content QA or AI evaluation is a plus.
• Comfortable following detailed evaluation rubrics.

Mansioni

• Review AI-generated answers alongside source documents.
• Check whether factual claims are supported by available sources.
• Identify unsupported statements and hallucinations.
• Identify contradictions between the answer and source material.
• Determine whether the response accurately represents source information.
• Check whether important qualifications or limitations were omitted.
• Compare answers with reference answers when available.
• Categorize grounding errors.
• Document unsupported or contradictory claims with evidence.
• Provide structured feedback for improvement.

Conoscenze

RAG evaluation

Information retrieval

Quality assurance

Detail-oriented

Descrizione del lavoro

Globik AI is seeking RAG Answer Grounding Specialists to evaluate whether AI-generated answers are accurately supported by the documents or knowledge sources provided to the model. You will review AI answers alongside source material and identify unsupported claims, hallucinations, contradictions, and statements that go beyond the available evidence.

Responsibilities include reviewing answers with sources, checking evidence, and documenting grounding errors with evidence.