AI Safety Expert - Fully Remote | Upto $22/hr

mercor; India; Remote; INR 2,136,000 - 2,937,000; Part time

Job summary

Mercor is seeking AI Safety Experts to remotely test and strengthen AI systems, focusing on English and Malayalam language safety. The role involves red-teaming models, annotating failure data, and documenting actionable attack cases for customers.

As a contract position, you will work independently across projects, ensuring rigorous data quality, structured workflows, and clear communication with both technical and non-technical audiences.

Qualifications

• Fluent in English and Malayalam with native proficiency in both.
• Strong judgment about language and content accuracy.
• Rigorous attention to detail and ability to spot subtle errors.
• Structured approach to work following guidelines and quality standards.
• Clear communication for technical and non-technical audiences.
• Adaptable across projects, tasks and customers.

Responsibilities

• Red team conversational AI models and agents to identify jailbreaks, prompt injections, and misuse cases.
• Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks.
• Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.
• Document reproducibly by producing reports, datasets, and attack cases that customers can act on.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Bilingual English/Malayalam

Language accuracy judgment

Attention to detail

Structured workflow

Clear communication

Adaptability

Job description

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: AI Safety Experts — English & Malayalam

Type: Contract

Compensation: $16–$22/hour

Location: Remote

Role Responsibilities

• Red team conversational AI models and agents to identify jailbreaks, prompt injections, and misuse cases.
• Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks.
• Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.
• Document reproducibly by producing reports, datasets, and attack cases that customers can act on.
• Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications Must-Have

• Fluent Language Skills Required: English & Malayalam . Native fluency in English and Malayalam is required.
• Strong judgment about language and content accuracy.
• Rigorous attention to detail and ability to notice subtle errors.
• Structured approach to work following guidelines and quality standards.
• Clear communication skills for technical and non-technical audiences.
• Adaptability across projects, task types, and customers.

Preferred

• Experience in Adversarial ML : jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction.
• Cybersecurity skills: penetration testing, exploit development, reverse engineering.
• Understanding of socio-technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing.
• Creative probing skills: psychology, acting, writing for unconventional adversarial thinking.