Arabic AI Safety Evaluator & Portuguese Writer

Welo Data; San Francisco (CA); On-site; USD 38,641 - 55,035; Full time

Benefits offered by this job

Free gourmet dining

Snack suites with premium beverages

Modern collaborative spaces

Comprehensive Medical, Dental, and Vision

Commuter support with free transport

Job summary

Welo Data in San Francisco is hiring Data Labeling Associates for Project Perseus. This role focuses on evaluating Arabic AI systems, requiring professional proficiency in Portuguese and experience in AI safety. Responsibilities include assessing AI outputs, identifying bias, and collaborating with teams to refine evaluation frameworks. The position offers gourmet dining, medical benefits, and a full-time employment status, making it ideal for those wanting to influence AI evaluation processes.

Qualifications

• Professional-level proficiency in Portuguese (Portugal) required.
• B2 level English to navigate technical guidelines needed.
• 1-2 years of experience in writing, journalism, or content creation is essential.
• 2+ years of AI Safety expertise required.
• Ability to make sound judgment in ambiguous situations is critical.
• Curiosity about LLMs and confidence to flag issues necessary.

Responsibilities

• Evaluate Arabic AI outputs for accuracy, fluency, and tone.
• Identify bias, risks, and failure modes in Arabic datasets.
• Refine evaluation frameworks to better reflect Arabic dialects.
• Communicate trends in model performance to stakeholders.
• Ensure consistent quality across global AI workstreams.

Skills

Professional-level proficiency in Portuguese (Portugal)

B2 level or superior English skills

1–2 years of experience in professional writing

2+ years of experience in AI Safety

Critical Thinking

Technical Agility regarding LLMs

Education

Bachelor’s degree or higher

Job description

Welo Data in San Francisco is hiring Data Labeling Associates for Project Perseus. This role focuses on evaluating Arabic AI systems, requiring professional proficiency in Portuguese and experience in AI safety. Responsibilities include assessing AI outputs, identifying bias, and collaborating with teams to refine evaluation frameworks. The position offers gourmet dining, medical benefits, and a full-time employment status, making it ideal for those wanting to influence AI evaluation processes.