LLM AI Quality Analysts

Donato Technologies Inc; United States; Remote; USD 17,000 - 24,000; Part time

Job summary

Donato Technologies Inc is seeking an LLM/AI Quality Analyst (Personalization) for a 4-month remote contractor position. A Bachelor’s or Master’s degree in IT or related field is required, and English proficiency is essential. The role involves evaluating personalized AI/Gemini responses, creating multi-turn prompts, and providing detailed feedback.

The position requires 30–40 hours per week with four hours PST overlap. Immediate start date and USD $15 per hour rate offered.

Qualifications

• Strong English reading and writing skills.
• Analytical with attention to detail.
• Experience in AI evaluation, data annotation, or content moderation preferred.
• Ability to work independently in a remote environment.
• Laptop/desktop with reliable internet.
• Willingness to use a primary personal Google account and enable personal data sources for assessment.

Responsibilities

• Evaluate personalized AI/Gemini responses.
• Create and test multi-turn prompts.
• Assess AI responses for grounding, integration, and helpfulness.
• Compare model responses side-by-side.
• Identify incorrect personalization, hallucinations, and poor inferences.
• Provide detailed feedback and rationales.

Skills

English proficiency

Analytical thinking

Attention to detail

Independent work

Education

Bachelor’s or Master’s degree in IT or IT-related field

Job description

IMMEDIATE HIRING | LLM / AI QUALITY ANALYST

We are hiring for LLM – AI Quality Analysts (Personalization) – English for a 4-month remote contract opportunity.

Rate: $15/hr USD

Start Date: Immediately

Availability: 30–40 hours/week

PST Overlap: 4 hours required

Engagement: Contractor

Education: Bachelor’s or Master’s degree in IT or any IT-related field

Approved States:

• Alabama
• Arizona
• Colorado
• Florida
• Idaho
• Iowa
• Kentucky
• Michigan
• Minnesota
• Mississippi
• Missouri
• Montana
• New York
• North Carolina
• North Dakota
• Oklahoma
• Pennsylvania
• South Carolina
• South Dakota
• Virginia
• Wisconsin
• Wyoming

Requirements

• Strong English reading and writing skills
• Strong analytical and attention-to-detail skills
• AI evaluation, data annotation, content moderation, or related experience preferred
• Ability to work independently in a remote environment
• Laptop/Desktop with reliable internet
• Willingness to use a primary personal Google account and enable personal data sources for the assessment

What You’ll Do

• Evaluate personalized AI/Gemini responses
• Create and test multi-turn prompts
• Assess AI responses for Grounding, Integration, and Helpfulness
• Compare model responses side-by-side
• Identify incorrect personalization, poor inferences, and hallucinations
• Provide detailed feedback and rationales

This is a remote position.