AI Source-to-Answer Consistency QA Specialist

Globik AI; United States; Remote; USD 17,000 - 25,000; Full time

Job summary

Globik AI is seeking Source-to-Answer Consistency Specialists to evaluate whether AI-generated answers stay faithful to their supporting sources. You will compare passages and generated responses to identify changed meanings, contradictions, omitted conditions, or unsupported additions.

Roles include documenting evidence, maintaining consistent standards across large batches, and following project rubrics. A reliable internet connection is required; some candidates may complete a practical RAG

Qualifications

• Experience with RAG search information retrieval, research content QA, or AI evaluation is a plus.

Responsibilities

• Compare source passages with AI-generated answers.
• Check whether the answer preserves the meaning of the source.
• Identify contradictions, changed facts, and unsupported additions.
• Identify important conditions or qualifications that were omitted.
• Assess whether summaries remain faithful to source material.
• Document source evidence for evaluation decisions.
• Maintain consistent standards across large batches.
• Follow project-specific RAG evaluation rubrics precisely.

Skills

RAG search experience

QA experience

Job description

Globik AI is seeking Source-to-Answer Consistency Specialists to evaluate whether AI-generated answers stay faithful to their supporting sources. You will compare passages and generated responses to identify changed meanings, contradictions, omitted conditions, or unsupported additions.

Roles include documenting evidence, maintaining consistent standards across large batches, and following project rubrics. A reliable internet connection is required; some candidates may complete a practical RAG