AI Safety Testing Specialist

Expert Talent Pool

United States

Remote

USD 41,000 - 83,000

Part time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hourly compensation

Job summary

Expert Talent Pool seeks a Safety & Evaluation Tester to design prompts and multi-turn conversations that test model safety and document results.

You will probe jailbreak methods, hidden prompts, and prompt injections, evaluate bias across names and languages, and label content according to project guidelines. This role requires careful reporting and collaboration with the evaluation team.

Qualifications

  • 0 to 5 years of professional experience.
  • Security testing, CTFs, trust and safety, content moderation or policy analysis experience.
  • Experience testing systems or models by trying to break them and documenting results.
  • Experience applying written policies or guidelines to label content or behavior.
  • Strong written English and careful documentation habits.
  • Ability to work with sensitive content under structured guidelines.

Responsibilities

  • Write prompts and multi-turn conversations testing model adherence to safety guidelines.
  • Try known and novel jailbreak techniques and record outcomes.
  • Test for prompt injection using hidden instructions in documents and tool outputs.
  • Evaluate whether tool-using models can be manipulated into harmful actions.
  • Compare responses across demographic groups, names and languages to identify bias.
  • Review model responses against written safety policies and flag violations.
  • Label content as safe or unsafe per project guidelines.

Skills

Security testing
Policy analysis
Documentation
Strong written English

Tools

Burp Suite
Garak
PyRIT
OWASP LLM Top 10

Job description

Expert Talent Pool seeks a Safety & Evaluation Tester to design prompts and multi-turn conversations that test model safety and document results.

You will probe jailbreak methods, hidden prompts, and prompt injections, evaluate bias across names and languages, and label content according to project guidelines. This role requires careful reporting and collaboration with the evaluation team.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Expert Talent Pool, Safety Testing Associate
Expert Talent Pool, Safety Testing Associate

Expert Talent Pool • United States

Remote
USD 41,000 - 83,000
Hourly compensation
Remote Safety Testing Pro — Jailbreaks & Policy
Remote Safety Testing Pro — Jailbreaks & Policy

Clera • United States

Remote
USD 41,000 - 83,000
Fully remote
Project-matched work
Safety Testing Associate
Safety Testing Associate

Clera • United States

Remote
USD 41,000 - 83,000
Fully remote
Project-matched work
Expert Talent Pool, Safety Testing Associate
Expert Talent Pool, Safety Testing Associate

Clera • United States

Remote
USD 41,000 - 83,000
Expert Talent Pool, Safety Testing (Expert, 5+ Years)
Expert Talent Pool, Safety Testing (Expert, 5+ Years)

Expert Talent Pool • United States

Remote
USD 140,000 - 190,000
Expert Talent Pool, Safety Testing (Expert)
Expert Talent Pool, Safety Testing (Expert)

Clera • United States

Remote
USD 103,000 - 241,000
Project-based pay
Fully remote work
Lead AI Safety & Adversarial Testing Engineer
Lead AI Safety & Adversarial Testing Engineer

Expert Talent Pool • United States

Remote
USD 140,000 - 190,000
AI Safety & Red-Team Specialist
AI Safety & Red-Team Specialist

Vettedlance • United States

Remote
USD 83,000 - 124,000
Expert Talent Pool, Safety Testing (Expert, 5+ Years)
Expert Talent Pool, Safety Testing (Expert, 5+ Years)

Clera • United States

Remote
USD 103,000 - 241,000
Competitive hourly rate
AI Safety Testing Lead — Red Team & Jailbreak Expert
AI Safety Testing Lead — Red Team & Jailbreak Expert

OpenAI, Inc. • United States

Remote
USD 120,000 - 180,000