AI Safety Specialist - Bilingual

mercor; San Francisco (CA); Hybrid; AUD 32,000 - 43,000; Part time

Job summary

Mercor is seeking AI Safety Experts to remotely contract and evaluate conversational AI systems. The role emphasizes red-teaming, data annotation, risk classification, and producing actionable reports for customers.

Fluency in English and Malayalam is required, with strong attention to language accuracy and writing for diverse audiences. Applicants should apply a structured, independent, and deadline-driven approach, adapting across projects while maintaining high quality standards in

Qualifications

• Fluent in English and Malayalam.
• Strong judgment about language and content accuracy.
• Rigorous attention to detail and ability to notice subtle errors.
• Structured approach to work following guidelines and quality standards.
• Clear communication skills for technical and non-technical audiences.
• Adaptability across projects, task types, and customers.

Responsibilities

• Red team conversational AI models and agents to identify jailbreaks, prompt injections, and misuse cases.
• Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks.
• Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.
• Document reproducibly by producing reports, datasets, and attack cases that customers can act on.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Bilingual fluency

Judgment and accuracy

Attention to detail

Structured approach

Clear communication

Adaptability

Job description

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: AI Safety Experts — English & Malayalam

Type: Contract

Compensation: $16–$22/hour

Location: Remote

Role Responsibilities

• Red team conversational AI models and agents to identify jailbreaks, prompt injections, and misuse cases.
• Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks.
• Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.
• Document reproducibly by producing reports, datasets, and attack cases that customers can act on.
• Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications Must-Have

• Fluent Language Skills Required: English & Malayalam . Native fluency in English and Malayalam is required.
• Strong judgment about language and content accuracy.
• Rigorous attention to detail and ability to notice subtle errors.
• Structured approach to work following guidelines and quality standards.
• Clear communication skills for technical and non-technical audiences.
• Adaptability across projects, task types, and customers.

Preferred

• Experience in Adversarial ML : jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction.
• Cybersecurity skills: penetration testing, exploit development, reverse engineering.
• Understanding of socio-technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing.
• Creative probing skills: psychology, acting, writing for unconventional adversarial thinking.