Freelance Technical Writer - Generalist AI Reviewer

Uber AI Solutions; United States; On-site; USD 34,095 - 48,560; Part time

Job summary

A tech company is looking for analytical reviewers to evaluate AI-generated responses. The remote position requires strong judgment and detail orientation, with flexibility in hours between 5 to 40 a week. Responsibilities include scoring answers on various criteria and providing justifications. Candidates must have a Bachelor’s degree and experience in GenAI response evaluation. This role impacts the quality and reliability of AI systems, offering a flexible remote working opportunity with payment as a 1099 contractor at rates up to $30/hr.

Qualifications

• Experience in GenAI or LLM response evaluation is required.
• Ability to work independently in high-volume environments.
• Must follow structured guidelines rigorously.

Responsibilities

• Analyze the relationship between user inputs and AI outputs.
• Score responses for factual accuracy, truthfulness, naturalness, completeness, and depth of insight.
• Provide written justifications for ratings.
• Flag hallucinations or low-quality responses.

Skills

Analytical judgment

Attention to detail

Strong focus on factuality

Tech-savviness

Education

Bachelor’s degree or higher

Job description

Uber AI Solutions is Uber’s marketplace connecting skilled freelancers with Generative AI researchers and product teams working on cutting‑edge AI systems. We partner with independent contractors to support large‑scale model evaluation, alignment, and quality initiatives.

We are seeking analytical, detail‑oriented reviewers to evaluate AI‑generated responses across a broad range of general knowledge and Generative AI (GenAI) topics. In this role, you will assess model outputs across multiple quality dimensions, including truthfulness, completeness, and insightfulness, helping ensure AI systems meet high standards of accuracy and reliability.

This is a remote, contract‑based position offering flexible hours and the opportunity to work on cutting‑edge AI alignment and evaluation initiatives.

What you’ll work on

• Review prompt/context and model responses: Analyze the relationship between user inputs and AI outputs.
• Compare multiple outputs: Identify which responses best meet the established criteria.
• Evaluate responses across rubric dimensions: Score responses for factual accuracy, truthfulness, naturalness, completeness, and depth of insight.
• Select preferences: Use your editorial judgment to choose the highest quality response where applicable.
• Provide written justification: Write short, structured explanations for your ratings.
• Identify model gaps: Flag hallucinations, missing context, or low‑quality responses.
• Follow instructions: Apply guidelines precisely and consistently across varying tasks.

Who we’re looking for

• Bachelor’s degree or more.
• Experience reviewers who bring rigor, consistency, and strong analytical judgment to AI evaluation work.
• Prior experience in GenAI / LLM response evaluation is required.
• Highly analytical with a strong focus on factuality and accuracy.
• Comfortable working independently in high‑volume, task‑based environments.
• Detail‑oriented with the ability to follow structured guidelines.
• Tech‑savvy with solid computer literacy.
• Schedule: Fully flexible. Work from any time zone, for 5‑40 hours a week.
• Engagement: Long‑term opportunity with approximately 10,000 tasks available.
• Task duration: Each task is estimated to take about 15 minutes.
• Location: Remote (US‑based only).
• Payment type: 1099 independent contractor, paid through the Uber AI Solutions portal.
• Pay rate: up to $30/hr*

Why this work matters

Your contributions directly impact the quality, trustworthiness, and reliability of Generative AI systems used at scale. By improving how AI models evaluate and present information, your work helps advance responsible AI development and real‑world AI performance.