Italian Data Labeling Associate

Welocalize, Inc.; Boston (MA); On-site; USD 68,000 - 78,000; Full time

Benefits offered by this job

Paid vacation

Holiday pay

Sick leave

Health insurance

HSA

401(k)

Employee assistance

Free gourmet food

Free snacks

Commuter benefits

Job summary

Welocalize, Inc. is seeking a Data Labeling Associate for Italian speakers to evaluate AI outputs and provide structured feedback on data quality and model behavior. This 100% onsite role requires strong writing and attention to detail, with cross-functional collaboration to refine quality standards.

The position emphasizes critical thinking, adherence to guidelines, and the ability to communicate insights to leads and teammates, supporting real-world AI evaluation efforts.

Qualifications

• Native-level proficiency in Italian and a university degree.
• English at B2 level or higher.
• 1-2 years of professional writing experience with structured writing.
• Experience with safety considerations in GenAI data delivery.

Responsibilities

• Evaluate AI model outputs and provide structured feedback.
• Perform audit-based reviews of data and model behavior.
• Apply guidelines thoughtfully and flag when they don’t reflect real-world scenarios.
• Contribute to improving evaluation frameworks, not just executing them.
• Identify trends in model performance and communicate insights.
• Participate in team discussions, calibrations, and stakeholder syncs.
• Partner with leads and cross-functional teams to refine quality standards.
• Document findings in a clear, concise, and actionable way.

Skills

Italian (native) proficiency

English (B2+)

Strong writing skills

Attention to detail

Education

Bachelor's degree

Job description

Overview

Welo Data is looking for sharp, curious, and detail-oriented individuals to join our team as Data Labeling Associate.

This is not a traditional annotation role.

You’ll be working directly with cutting-edge AI systems - evaluating outputs, identifying gaps, and helping improve how these systems behave in real-world scenarios. The work sits at the intersection of data quality, model evaluation, and human judgment, where your ability to think critically matters just as much as following guidelines.

We’re looking for people who are naturally curious about AI, comfortable forming opinions, and confident in contributing to conversations with teammates, leads, and stakeholders.

Project Details

• Job Title: Project Perseus | Data Labeling Associate - Italian Speakers (Human-in-the-Loop AI)
• Hiring in: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Los Angeles, Washington DC, Boston
• Hours: Full-time, 40 hours per week
• Employment Type: W2 Full-Time Employee
• Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)
• Pay Rate: $34/hour

Important

This is a 100% onsite position - remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: New York City, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Los Angeles, Washington DC, Boston. Please only apply if you meet this location requirement.

What You’ll Do

• Evaluate AI model outputs and provide structured, high-quality feedback
• Perform audit-based reviews of data and model behavior - identifying patterns, edge cases, and failure modes
• Apply guidelines thoughtfully - and flag when they don't reflect real-world scenarios
• Contribute to improving evaluation frameworks, not just executing them
• Identify trends in model performance and communicate insights clearly
• Participate in team discussions, calibrations, and stakeholder syncs
• Partner with leads and cross-functional teams to refine quality standards
• Document findings in a clear, concise, and actionable way

What We’re Looking For

• Native-level proficiency in Italian and a university degree (Bachelor's or higher).
• B2 or superior level of English.
• 1-2 years of professional writing experience with strong, structured writing skills
• Ability to apply complex writing rules and guidelines consistently
• Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
• Strong critical thinking and attention to detail
• Ability to make sound judgment calls in ambiguous situations
• Naturally curious about AI, technology, and how systems behave
• Comfortable speaking up, asking questions, and contributing ideas
• Strong written and verbal communication skills
• Ability to stay consistent while working with evolving guidelines
• Experience in data quality, QA, annotation, or analysis is helpful - but not required

Benefits

• Paid Vacation: 6 days
• Paid Company Holidays: 2 days (Memorial Day and Labor Day)
• Paid Sick Leave: accrued per applicable state law and company policy
• Medical, Dental, and Vision Insurance (eligibility applies)
• Health Savings Account (HSA)
• 401(k) Retirement Plan
• Employee Assistance Program
• Additional voluntary benefits (life, accident, critical illness, etc.)
• Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
• Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
• Unique Campus Features: Some locations include roof-top nature parks
• Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.