AI Safety Data Labeler — Arabic Eval & Portuguese Pro (NYC On‑Site)

Welo Data; New York (NY); On-site; USD 38,641 - 55,035; Full time

Benefits offered by this job

Gourmet dining with free meals

Snack suites with beverages

Modern collaborative spaces

Comprehensive Medical, Dental, and Vision coverage

Commute support and shuttles

Job summary

Welo Data is seeking Data Labeling Associates for Project Perseus in New York City. This position goes beyond traditional data roles, focusing on evaluating AI systems in handling Arabic language nuances. Candidates should demonstrate professional-level Portuguese proficiency, B2 English skills, and have experience in writing and AI safety. The job offers a full-time, on-site work environment with premium benefits including gourmet dining and comprehensive medical coverage.

Qualifications

• Must have professional-level proficiency in Portuguese (Portugal).
• Requires B2 or superior level English skills.
• Expect 1-2 years in professional writing or content creation.
• At least 2 years focused on AI safety and trust.
• Capable of making sound judgment calls in ambiguous scenarios.
• Should show curiosity about LLMs and AI behavior.

Responsibilities

• Critique Arabic AI outputs for accuracy and fluency.
• Identify bias and risks in Arabic datasets as part of safety engineering.
• Apply complex linguistic guidelines to evaluate real-world Arabic dialects.
• Communicate findings about model performance to technical stakeholders.
• Participate in team syncs for quality assurance across AI workstreams.

Skills

Professional-level proficiency in Portuguese (Portugal)

B2 level English skills

1-2 years of experience in professional writing

2+ years in AI safety expertise

Critical thinking in ambiguous situations

Curiosity about LLMs

Education

Bachelor's degree or higher

Job description

Welo Data is seeking Data Labeling Associates for Project Perseus in New York City. This position goes beyond traditional data roles, focusing on evaluating AI systems in handling Arabic language nuances. Candidates should demonstrate professional-level Portuguese proficiency, B2 English skills, and have experience in writing and AI safety. The job offers a full-time, on-site work environment with premium benefits including gourmet dining and comprehensive medical coverage.