Remote AI Quality Analyst: Personalization & Evaluation

Turing; East Providence (RI); Remote; USD 34,000 - 55,000; Full time

Job summary

A leading AI research firm is seeking an AI Quality Analyst to evaluate personalized AI interactions. This role requires proficiency in Portuguese and offers the chance to assess how well AI models utilize user data for relevant responses. Candidates should have strong analytical skills, exceptional written communication abilities, and a background in relevant fields. This is a contractor position for 3 months with flexible hours, preferably with 4 hours overlapping with PST.

Qualifications

• Ability to read and write in Portuguese with a high degree of competence.
• Experience in data annotation, AI quality evaluation, or content moderation is preferred.
• Self-motivated and able to work independently in a remote setting.

Responsibilities

• Design and execute multi-turn conversational prompts utilizing personal information.
• Evaluate model responses based on intent and check for appropriate personalization.
• Analyze responses for grounding issues and assess integration quality.

Skills

Portuguese Proficiency

Exceptional Analytical Thinking

Creative Prompt Engineering

Meticulous Attention to Detail

Excellent Written Communication

Independence

Communication

Education

BS/BA degree or equivalent experience

Job description

A leading AI research firm is seeking an AI Quality Analyst to evaluate personalized AI interactions. This role requires proficiency in Portuguese and offers the chance to assess how well AI models utilize user data for relevant responses. Candidates should have strong analytical skills, exceptional written communication abilities, and a background in relevant fields. This is a contractor position for 3 months with flexible hours, preferably with 4 hours overlapping with PST.