AI Red Teamer — LLM Safety & Adversarial Testing

We Love AI Jobs; Northern (KY); Remote; USD 67,000 - 198,000; Full time

Job summary

We Love AI Jobs is seeking an AI Red Teamer for a fully remote role based in the USA. You will craft adversarial prompts to stress-test large language models, evaluate guardrails, and document vulnerabilities to strengthen defenses in collaboration with researchers and engineers.

Day-to-day work includes multi-turn prompt design, scoring outputs against harm taxonomies, and contributing to taxonomy development.

Qualifications

• Design adversarial prompts to test AI guardrails across risk categories.
• Evaluate model outputs using structured harm taxonomies and rubrics.
• Collaborate with researchers, engineers, and data scientists on defense improvements.

Responsibilities

• Craft creative prompts and multi-turn scenarios to stress-test AI guardrails.
• Discover ways around safety filters using jailbreak, evasion, and prompt injection techniques.
• Evaluate and score model responses against structured harm taxonomies.
• Document experiments clearly including methods and findings.
• Collaborate with engineers, data scientists, and researchers to strengthen defenses.

Skills

Adversarial prompting

Large language models

Jailbreak techniques

Prompt injection

Model evaluation

Safety rubrics

Python

Structured data annotation

Tools

Python

Job description

We Love AI Jobs is seeking an AI Red Teamer for a fully remote role based in the USA. You will craft adversarial prompts to stress-test large language models, evaluate guardrails, and document vulnerabilities to strengthen defenses in collaboration with researchers and engineers.

Day-to-day work includes multi-turn prompt design, scoring outputs against harm taxonomies, and contributing to taxonomy development.