Quality Analyst (Italian) | $15.3/hr Remote

Crossing Hurdles; Indiana (PA); Remote; USD 15,000 - 21,000; Part time

Job summary

Crossing Hurdles is seeking an LLM - AI Quality Analyst Personalization - Italian for remote, hourly engagement. You will evaluate personalization quality, design multi-turn prompts, and assess model outputs for accuracy and hallucinations.

Strong Italian skills and data-evaluation experience are essential, with 30-40 hours per week and PST overlap. The role demands precise analysis, clear rationales, and meticulous documentation to help improve AI model performance while maintaining data

Qualifications

• Strong proficiency in Italian with excellent reading and writing.
• Experience in data annotation, AI evaluation, content moderation, or similar roles.
• Strong analytical thinking to evaluate nuanced AI responses.
• Ability to design creative multi-turn prompts based on personal context.
• Excellent written communication and attention to detail.
• Full-time availability with flexibility and ability to overlap with PST time zone.
• Bachelor's degree or equivalent in a relevant analytical field.

Responsibilities

• Evaluate AI model responses for personalization quality including grounding, integration, and helpfulness.
• Design and execute multi-turn prompts based on personal context to test AI capabilities.
• Analyze responses for hallucinations, incorrect personalization, and flawed inferences.
• Perform side-by-side comparisons of model outputs to determine quality and effectiveness.
• Write clear and structured rationales for response evaluations and rankings.
• Provide detailed feedback and annotations to improve AI model performance.
• Maintain strict data hygiene and ensure accurate documentation of evaluations.

Skills

Italian language

Data annotation

AI evaluation

Content moderation

Education

Bachelor's degree or equivalent

Job description

Position: LLM - AI Quality Analyst Personalization - Italian

Type: Hourly contract

Compensation: $11 - $15/hour

Location: Remote

Commitment: 30 40 hours/week

Role Responsibilities

• Evaluate AI model responses for personalization quality including grounding, integration, and helpfulness
• Design and execute multi-turn prompts based on personal context to test AI capabilities
• Analyze responses for hallucinations, incorrect personalization, and flawed inferences
• Perform side-by-side (SxS) comparison of model outputs to determine quality and effectiveness
• Write clear and structured rationales for response evaluations and rankings
• Provide detailed feedback and annotations to improve AI model performance
• Maintain strict data hygiene and ensure accurate documentation of evaluations

Requirements

• Strong proficiency in Italian with excellent reading and writing skills
• Experience in data annotation, AI evaluation, content moderation, or similar roles
• Strong analytical thinking with the ability to evaluate nuanced AI responses
• Ability to design creative multi-turn prompts based on personal context
• Excellent written communication and attention to detail
• Full-time availability with flexibility and ability to overlap with PST time zone
• Bachelor s degree or equivalent experience in a relevant analytical field

Application Process

• Apply/Easy Apply and check email for application form
• Fill Google form
• Assessment Link (After shortlisting)
• Screener
• 1/3 assessments mandatory
• Language vetting