RAG Context Quality Engineer for AI Insights

Globik AI; United States; Remote; USD 17,000 - 25,000; Full time

Job summary

Globik AI is seeking a RAG Context Quality Specialist to evaluate whether the context supplied to a language model is clear, useful, complete, and appropriate for answer generation.

You will inspect retrieved context and determine whether it provides the right information in a usable form, identifying noise, redundancy, missing context, and conflicting information. This role requires careful analysis and clear documentation of findings.

Qualifications

• Experience with RAG search information retrieval, research content QA or AI evaluation is a plus.

Responsibilities

• Review context supplied to AI models before answer generation.
• Assess whether the context contains useful information for the query.
• Identify irrelevant or noisy passages.
• Identify missing information and insufficient context.
• Flag duplicated or conflicting source content.
• Evaluate whether context is organized and understandable when required.
• Categorize context-quality issues.
• Document difficult cases and provide structured feedback.
• Maintain consistent evaluation quality across large datasets.

Skills

RAG evaluation

Job description

Globik AI is seeking a RAG Context Quality Specialist to evaluate whether the context supplied to a language model is clear, useful, complete, and appropriate for answer generation.

You will inspect retrieved context and determine whether it provides the right information in a usable form, identifying noise, redundancy, missing context, and conflicting information. This role requires careful analysis and clear documentation of findings.