Portuguese (Portugal) Data Labeling Associate - California based

Welo Data; San Francisco (CA); On-site; USD 38,641 - 55,035; Full time

Benefits offered by this job

Free gourmet dining

Snack suites with premium beverages

Modern collaborative spaces

Comprehensive Medical, Dental, and Vision

Commuter support with free transport

Job summary

Welo Data in San Francisco is hiring Data Labeling Associates for Project Perseus. This role focuses on evaluating Arabic AI systems, requiring professional proficiency in Portuguese and experience in AI safety. Responsibilities include assessing AI outputs, identifying bias, and collaborating with teams to refine evaluation frameworks. The position offers gourmet dining, medical benefits, and a full-time employment status, making it ideal for those wanting to influence AI evaluation processes.

Qualifications

• Professional-level proficiency in Portuguese (Portugal) required.
• B2 level English to navigate technical guidelines needed.
• 1-2 years of experience in writing, journalism, or content creation is essential.
• 2+ years of AI Safety expertise required.
• Ability to make sound judgment in ambiguous situations is critical.
• Curiosity about LLMs and confidence to flag issues necessary.

Responsibilities

• Evaluate Arabic AI outputs for accuracy, fluency, and tone.
• Identify bias, risks, and failure modes in Arabic datasets.
• Refine evaluation frameworks to better reflect Arabic dialects.
• Communicate trends in model performance to stakeholders.
• Ensure consistent quality across global AI workstreams.

Skills

Professional-level proficiency in Portuguese (Portugal)

B2 level or superior English skills

1–2 years of experience in professional writing

2+ years of experience in AI Safety

Critical Thinking

Technical Agility regarding LLMs

Education

Bachelor’s degree or higher

Job description

Refine the Future of Multilingual AI

Do you have professional-level proficiency in Portuguese (Portugal) and a background in writing, with attention to AI safety? Welo Data is looking for Data Labeling Associates for Project Perseus.

This is not a traditional annotation role. You will be working at the intersection of human judgment and machine learning, evaluating how cutting-edge AI systems handle Arabic language nuances, cultural context, and safety boundaries.

The Mission: Human-in-the-Loop Excellence:

• Model Evaluation: Critique Arabic AI outputs for accuracy, fluency, and tone, providing structured feedback to drive model improvement.
• Safety Engineering: Use your 2+ years of GenAI safety experience to identify bias, risks, and failure modes in Arabic datasets.
• Guideline Evolution: Apply complex linguistic guidelines thoughtfully and help refine evaluation frameworks to reflect real-world Arabic dialects and contexts.
• Strategic Insights: Identify trends in model performance and communicate findings clearly to technical stakeholders.
• Collaborative Calibration: Participate in team syncs to ensure consistent quality across global AI workstreams.

Project Details:

• Employment Type: W2 Full-Time Employee
• Hours: 40 hours/week
• Location: California (On-Site: San Francisco, Sunnyvale, or Burlingame)
• Pay Rate: 34 $ (per hour)

What We’re Looking For:

• Linguistic Mastery: Professional-level proficiency in Portuguese (Portugal) and a bachelor’s degree or higher.
• English Proficiency: B2 level or superior English skills to navigate technical guidelines and stakeholder syncs.
• Professional Writing: 1–2 years of experience in professional writing, journalism, or content creation.
• AI Safety Expertise: 2+ years of experience focusing on Safety & Trust in Generative AI data delivery.
• Critical Thinking: The ability to make sound judgment calls in ambiguous "grey area" scenarios.
• Technical Agility: A natural curiosity about LLMs and the confidence to flag issues when a model's behavior feels "off."

Premium Campus Benefits:

• Gourmet Dining: Free breakfast, lunch, and dinner with a wide variety of cuisines.
• Snack Suites: Micro-kitchens stocked with premium coffee, beverages, and healthy treats.
• Campus Features: Modern collaborative spaces and unique amenities like rooftop nature parks (at select locations).
• Full Security: Comprehensive Medical, Dental, and Vision + 401(k) and HSA eligibility.
• Commuter Support: Free transport, shuttles, and bike-to-work perks.

Why This Role:

This is an opportunity to move beyond traditional data work and play a direct role in how AI systems are evaluated and improved. The work is fast-moving, collaborative, and increasingly central to how modern AI systems are built and deployed.