Portuguese (Portugal) Data Labeling Associate - California based

Welo Data; San Francisco (CA); On-site; USD 70,000 - 75,000; Full time

Benefits offered by this job

Gourmet dining

Snack suites

Commuter support

Comprehensive medical, dental, and vision benefits

Job summary

Welo Data in San Francisco seeks a full-time AI Evaluator with professional proficiency in Portuguese (Portugal) and experience in Generative AI safety. The role involves critiquing AI outputs, identifying biases, and refining evaluation frameworks. Candidates should possess a bachelor’s degree, strong writing skills, and at least 2 years of experience in AI safety. This position offers a range of premium campus benefits including gourmet dining and commuter support, aimed at fostering a collaborative work environment.

Qualifications

• 2+ years of experience focusing on Safety & Trust in Generative AI.
• 1–2 years of experience in professional writing, journalism, or content creation.
• Ability to critique AI outputs for accuracy, fluency, and tone.

Responsibilities

• Critique Arabic AI outputs for accuracy, fluency, and tone.
• Identify bias, risks, and failure modes in Arabic datasets.
• Refine evaluation frameworks to reflect real-world Arabic dialects.

Skills

Professional-level proficiency in Portuguese (Portugal)

B2 level English proficiency

Professional writing experience

AI safety expertise

Critical thinking

Education

Bachelor's degree or higher

Job description

Overview

Refine the Future of Multilingual AI
Do you have professional-level proficiency in Portuguese (Portugal) and a background in writing, with attention to AI safety?

Responsibilities

• Model Evaluation: Critique Arabic AI outputs for accuracy, fluency, and tone, providing structured feedback to drive model improvement.
• Safety Engineering: Use your 2+ years of GenAI safety experience to identify bias, risks, and failure modes in Arabic datasets.
• Guideline Evolution: Apply complex linguistic guidelines thoughtfully and help refine evaluation frameworks to reflect real-world Arabic dialects and contexts.
• Strategic Insights: Identify trends in model performance and communicate findings clearly to technical stakeholders.
• Collaborative Calibration: Participate in team syncs to ensure consistent quality across global AI workstreams.

Project Details

• Employment Type: W2 Full-Time Employee
• Hours: 40 hours/week
• Location: California (On-Site: San Francisco, Sunnyvale, or Burlingame)
• Pay Rate: 34 $ (per hour)

What We’re Looking For

• Linguistic Mastery: Professional-level proficiency in Portuguese (Portugal) and a bachelor’s degree or higher.
• English Proficiency: B2 level or superior English skills to navigate technical guidelines and stakeholder syncs.
• Professional Writing: 1–2 years of experience in professional writing, journalism, or content creation.
• AI Safety Expertise: 2+ years of experience focusing on Safety & Trust in Generative AI data delivery.
• Critical Thinking: The ability to make sound judgment calls in ambiguous "grey area" scenarios.
• Technical Agility: A natural curiosity about LLMs and the confidence to flag issues when a model's behavior feels "off."

Premium Campus Benefits

• Gourmet Dining: Free breakfast, lunch, and dinner with a wide variety of cuisines.
• Snack Suites: Micro-kitchens stocked with premium coffee, beverages, and healthy treats.
• Campus Features: Modern collaborative spaces and unique amenities like rooftop nature parks (at select locations).
• Full Security: Comprehensive Medical, Dental, and Vision + 401(k) and HSA eligibility.
• Commuter Support: Free transport, shuttles, and bike-to-work perks.

Why This Role

This is an opportunity to move beyond traditional data work and play a direct role in how AI systems are evaluated and improved. The work is fast-moving, collaborative, and increasingly central to how modern AI systems are built and deployed.