LLM Evaluation Specialist — Flexible, Freelance

Revelo; United States; Remoto; USD 55.000 - 110.000; Tempo pieno

Descrizione del lavoro

Revelo seeks a Research Specialist in LLM Training to perform qualitative and structured evaluations that improve AI performance. You will review prompts for clarity and domain alignment, assess multiple AI responses for accuracy and depth, and compare options across factuality and reliability.

You will provide actionable feedback to curb hallucinations and guide model improvements. This freelance, flexible-hours role emphasizes technical writing and precise analysis to help refine AI systems

Competenze

• Reviewing prompts for clarity, relevance, and domain alignment.
• Analyzing AI-generated responses for accuracy, depth, and formatting.
• Comparing responses across dimensions like factuality and source reliability.
• Providing actionable feedback to flag hallucinations and improve model behavior.

Mansioni

• Prompt Analysis: Review user prompts for clarity and relevance.
• Response Evaluation: Assess AI outputs for accuracy and depth of research.
• Comparative Assessment: Identify preferred responses and explain choices concisely.
• Feedback & Edge-Case Identification: Flag hallucinations and suggest improvements.

Conoscenze

Research Analysis

Fact-Checking

Critical Thinking

Technical Writing

Descrizione del lavoro

Revelo seeks a Research Specialist in LLM Training to perform qualitative and structured evaluations that improve AI performance. You will review prompts for clarity and domain alignment, assess multiple AI responses for accuracy and depth, and compare options across factuality and reliability.

You will provide actionable feedback to curb hallucinations and guide model improvements. This freelance, flexible-hours role emphasizes technical writing and precise analysis to help refine AI systems