AI Safety Expert - Fully Remote | Upto $22/hr

mercor; United States; Remote; USD 22,000 - 30,000; Full time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. This remote contract role focuses on AI safety testing in English and Malayalam, requiring meticulous attention to language accuracy and adherence to testing playbooks.

You will generate data, annotate failures, and document actionable attack cases for clients and teams. The position is remote, asynchronous, and compensation ranges from $16–$22 per hour.

Qualifications

• Native fluency in English and Malayalam is required.
• Strong judgment about language accuracy.
• Rigorous attention to detail and ability to notice subtle errors.
• Structured approach to work following guidelines and quality standards.
• Clear communication skills for technical and non-technical audiences.
• Adaptability across projects, task types, and customers.

Responsibilities

• Red team conversational AI models and agents to identify jailbreaks, prompt injections, and misuse cases.
• Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks.
• Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.
• Document reproducibly by producing reports, datasets, and attack cases that customers can act on.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

English & Malayalam

Attention to detail

Structured workflow

Clear communication

Adaptability

Job description

About the Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Experts — English & Malayalam

Type:Contract

Compensation:$16–$22/hour

Location:Remote

Role Responsibilities

• Red team conversational AI models and agents to identify jailbreaks, prompt injections, and misuse cases.
• Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks.
• Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.
• Document reproducibly by producing reports, datasets, and attack cases that customers can act on.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

• Fluent Language Skills Required:English & Malayalam. Native fluency in English and Malayalam is required.
• Strong judgment about language and content accuracy.
• Rigorous attention to detail and ability to notice subtle errors.
• Structured approach to work following guidelines and quality standards.
• Clear communication skills for technical and non-technical audiences.
• Adaptability across projects, task types, and customers.

Preferred

• Experience in Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction.
• Cybersecurity skills: penetration testing, exploit development, reverse engineering.
• Understanding of socio-technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing.
• Creative probing skills: psychology, acting, writing for unconventional adversarial thinking.