Remote LLM/GenAI Evaluation Specialist — Flexible Hours

Lifted (an Upwork Company); United States; Remote; USD 70,000 - 100,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Job summary

Lifted, an Upwork Company, is seeking evaluators skilled in LLM and GenAI data assessment to help verify model outputs across multiple modalities. You will follow structured rubrics and research unfamiliar topics using trusted sources to ensure quality and reliability.

This remote role offers flexibility and a variable workload, with tasks available across arts, culture, history, science, and more. A Bachelor's degree is required, and prior experience with multimodal evaluation is preferred.

Qualifications

• 3+ years of hands-on LLM/GenAI data evaluation.
• Bachelor's Degree required.
• Ability to research unfamiliar topics using trusted sources.

Responsibilities

• Evaluate model-generated content against quality rubrics (factuality, consistency, aesthetics).
• Assess content across text, images, audio, video, HTML widgets, PDFs.
• Follow detailed project guidelines and document findings.

Skills

LLM data evaluation

GenAI evaluation

Research skills

Multimodal evaluation

Education

Bachelor's Degree

Job description

Lifted, an Upwork Company, is seeking evaluators skilled in LLM and GenAI data assessment to help verify model outputs across multiple modalities. You will follow structured rubrics and research unfamiliar topics using trusted sources to ensure quality and reliability.

This remote role offers flexibility and a variable workload, with tasks available across arts, culture, history, science, and more. A Bachelor's degree is required, and prior experience with multimodal evaluation is preferred.