Remote AI Quality Evaluator (Italian) – Personalization

Crossing Hurdles; Town of Italy (NY); On-site; USD 15,153 - 20,664; Part time

Job summary

A tech-focused company is seeking a qualified LLM - AI Quality Analyst Personalization, fluent in Italian, to evaluate and improve AI model responses. In this remote role, you will analyze AI outputs, design multi-turn prompts, and provide structured feedback to enhance performance. Candidates should have strong analytical skills, a Bachelor's degree or equivalent experience, and be available for a flexible commitment of 30-40 hours per week, overlapping with PST time zone.

Qualifications

• Strong proficiency in Italian with excellent reading and writing skills.
• Experience in data annotation, AI evaluation, content moderation, or similar roles.
• Strong analytical thinking with the ability to evaluate nuanced AI responses.

Responsibilities

• Evaluate AI model responses for personalization quality including grounding and helpfulness.
• Design and execute multi-turn prompts based on personal context to test AI capabilities.
• Analyze responses for hallucinations, incorrect personalization, and flawed inferences.

Skills

Proficiency in Italian

Analytical thinking

Attention to detail

Writing skills

Education

Bachelor’s degree in a relevant analytical field

Job description

A tech-focused company is seeking a qualified LLM - AI Quality Analyst Personalization, fluent in Italian, to evaluate and improve AI model responses. In this remote role, you will analyze AI outputs, design multi-turn prompts, and provide structured feedback to enhance performance. Candidates should have strong analytical skills, a Bachelor's degree or equivalent experience, and be available for a flexible commitment of 30-40 hours per week, overlapping with PST time zone.