LLM AI Quality Analyst - Personalization (Remote)

Donato Technologies Inc; United States; Remote; USD 17,000 - 24,000; Part time

Job summary

Donato Technologies Inc is seeking an LLM/AI Quality Analyst (Personalization) for a 4-month remote contractor position. A Bachelor’s or Master’s degree in IT or related field is required, and English proficiency is essential. The role involves evaluating personalized AI/Gemini responses, creating multi-turn prompts, and providing detailed feedback.

The position requires 30–40 hours per week with four hours PST overlap. Immediate start date and USD $15 per hour rate offered.

Qualifications

• Strong English reading and writing skills.
• Analytical with attention to detail.
• Experience in AI evaluation, data annotation, or content moderation preferred.
• Ability to work independently in a remote environment.
• Laptop/desktop with reliable internet.
• Willingness to use a primary personal Google account and enable personal data sources for assessment.

Responsibilities

• Evaluate personalized AI/Gemini responses.
• Create and test multi-turn prompts.
• Assess AI responses for grounding, integration, and helpfulness.
• Compare model responses side-by-side.
• Identify incorrect personalization, hallucinations, and poor inferences.
• Provide detailed feedback and rationales.

Skills

English proficiency

Analytical thinking

Attention to detail

Independent work

Education

Bachelor’s or Master’s degree in IT or IT-related field

Job description

Donato Technologies Inc is seeking an LLM/AI Quality Analyst (Personalization) for a 4-month remote contractor position. A Bachelor’s or Master’s degree in IT or related field is required, and English proficiency is essential. The role involves evaluating personalized AI/Gemini responses, creating multi-turn prompts, and providing detailed feedback.

The position requires 30–40 hours per week with four hours PST overlap. Immediate start date and USD $15 per hour rate offered.