Italian Data Labeling & AI Evaluation Specialist

Welocalize, Inc.; New York (NY); On-site; USD 90,922,000 - 101,942,000; Full time

Benefits offered by this job

Paid Vacation

Paid Holidays

Sick Leave

Health Insurance

HSA

401(k)

Employee Assistance Program

Additional voluntary benefits

Free meals

Snacks & beverages

Campus features

Commuter benefits

Job summary

Welocalize, Inc. is hiring a Data Labeling Associate (Italian speakers) to work onsite in the United States. You will evaluate AI outputs, provide structured feedback, and audit data quality for real-world model behavior.

This role emphasizes clear judgment, strict adherence to guidelines, and teamwork to improve evaluation frameworks. Qualifications include native Italian, at least a Bachelor’s degree, 1–2 years writing experience, and English at B2+ level.

Qualifications

• Native-level proficiency in Italian.
• Bachelor's degree or higher.
• 1–2 years of professional writing experience with strong, structured writing skills.
• Ability to apply complex writing rules and guidelines consistently.
• 2+ years of experience related to safety considerations in GenAI data delivery.
• Strong critical thinking and attention to detail.
• Ability to make sound judgments in ambiguous situations.
• Curious about AI and technology, with good communication skills.

Responsibilities

• Evaluate AI model outputs and provide structured, high-quality feedback.
• Conduct audit-based reviews of data and model behavior; identify patterns, edge cases, and failure modes.
• Apply guidelines thoughtfully and flag when they don’t reflect real-world scenarios.
• Contribute to improving evaluation frameworks, not just executing them.
• Identify trends in model performance and communicate insights clearly.
• Participate in team discussions, calibrations, and stakeholder syncs.
• Collaborate with leads and cross-functional teams to refine quality standards.
• Document findings clearly and concisely.

Skills

Italian (native-level)

English (B2+)

Writing experience

Critical thinking

Attention to detail

Guideline application

Communication skills

Data quality / QA experience (helpful)

Education

Bachelor's degree or higher

Job description

Welocalize, Inc. is hiring a Data Labeling Associate (Italian speakers) to work onsite in the United States. You will evaluate AI outputs, provide structured feedback, and audit data quality for real-world model behavior.

This role emphasizes clear judgment, strict adherence to guidelines, and teamwork to improve evaluation frameworks. Qualifications include native Italian, at least a Bachelor’s degree, 1–2 years writing experience, and English at B2+ level.