English Trust & Safety Evaluator — Adversarial Testing

TELUS International AI Finland Oy; Tampere; Vor Ort; EUR 45.000 - 66.000; Vollzeit

Benefits dieser Stelle

Occupational health care at Terveystol

Lunch benefit with ePassi

After 4 months, Pohjola Comprehensive;

Comprehensive leisure-time accident;

Sport & Culture & Heath benefits via E

Zusammenfassung

Telus International AI Finland Oy seeks a Trust & Safety Evaluator to conduct adversarial testing and safety evaluation of generative AI features in Tampere, Finland. You will craft queries, assess outputs, and provide critical feedback within a six-month project timeline.

Responsibilities include designing realistic query sequences, creating attack scenarios, assigning risk ratings, and spotting biases across diverse cultural contexts. Strong US-English cultural understanding is essential.

Qualifikationen

• Preferred backgrounds include creative writing, social media management, content moderation, digital marketing, journalism or related fields.

Aufgaben

• Write, review and evaluate diverse and challenging queries designed to test the system’s limits and expose problematic outputs.
• Design and execute sequences of queries simulating realistic, unfolding conversations.
• Craft attack scenarios using crescendo attacks and context manipulation to test the system
• Age-Appropriate Safety Evaluation: to guide adversarial query crafting and safety evaluation.
• Assign risk ratings to AI Generated content based on safety guidelines.
• Detect and articulate potential biases in system-generated content
• Identify subtle unsafe elements, inconsistencies, or problematic implications
• Evaluate specific cultural and language knowledge across different cultural contexts.
• Leverage familiarity with relevant domains, genres, cultural references, and industry context.
• Complete adversarial testing tasks within time constraints
• Maintain high accuracy and attention to detail while working at pace.

Kenntnisse

English (US)

US culture awareness

Cultural awareness

Cross-cultural understanding

Youth audience familiarity

Content evaluation

Query design

Attack scenarios

Risk rating

Bias detection

Attention to detail

Creative writing

Youth slang

Ausbildung

Creative Writing

Social Media Management

Content Moderation

Digital Marketing

Journalism

Public Relations

Copywriting

Jobbeschreibung

Telus International AI Finland Oy seeks a Trust & Safety Evaluator to conduct adversarial testing and safety evaluation of generative AI features in Tampere, Finland. You will craft queries, assess outputs, and provide critical feedback within a six-month project timeline.

Responsibilities include designing realistic query sequences, creating attack scenarios, assigning risk ratings, and spotting biases across diverse cultural contexts. Strong US-English cultural understanding is essential.