LLM Model Response Evaluation

Lifted (Upwork); United States; Remote; USD 34,000 - 83,000; Full time

Benefits offered by this job

Flexible remote work

Variable workload

No guaranteed hours

Job summary

Lifted is seeking experienced evaluators to assess model-generated content across text, images, audio, video, HTML widgets, PDFs and more. You will apply defined rubrics for factuality and consistency to deliver dependable quality signals for product teams.

Applicants should have 3+ years in LLM/GenAI data evaluation, a Bachelor's degree, strong research skills, and comfort evaluating multimodal content. Remote work with flexible workload and no guaranteed hours.

Qualifications

• 3+ years of hands-on experience in LLM / GenAI data evaluation.
• Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
• Comfortable evaluating content across multiple modalities.

Responsibilities

• Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
• The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
• The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
• Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
• Each task will include detailed project guidelines within the evaluation platform.

Skills

LLM/GenAI evaluation

Research skills

Multimodal evaluation

Education

Bachelor's degree

Job description

• Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
• The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
• The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
• Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
• Each task will include detailed project guidelines within the evaluation platform.

Qualifications

• 3+ years of hands-on experience in LLM / GenAI data evaluation.
• Bachelor's Degree required
• Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
• Comfortable evaluating content across multiple modalities

Additional information

Flexible and remote work
Variable workload:Accept or decline tasks based on your availability
No guaranteed hours:Workload may vary weekly

About Lifted

Our client, a global technology company that helps businesses build, train, and manage AI systems is looking forexperts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Open to applicants in

United States, Canada