Expert Talent Pool, Safety Testing Associate

Expert Talent Pool

United States

Remote

USD 41,000 - 83,000

Part time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hourly compensation

Job summary

Expert Talent Pool seeks a Safety & Evaluation Tester to design prompts and multi-turn conversations that test model safety and document results.

You will probe jailbreak methods, hidden prompts, and prompt injections, evaluate bias across names and languages, and label content according to project guidelines. This role requires careful reporting and collaboration with the evaluation team.

Qualifications

  • 0 to 5 years of professional experience.
  • Security testing, CTFs, trust and safety, content moderation or policy analysis experience.
  • Experience testing systems or models by trying to break them and documenting results.
  • Experience applying written policies or guidelines to label content or behavior.
  • Strong written English and careful documentation habits.
  • Ability to work with sensitive content under structured guidelines.

Responsibilities

  • Write prompts and multi-turn conversations testing model adherence to safety guidelines.
  • Try known and novel jailbreak techniques and record outcomes.
  • Test for prompt injection using hidden instructions in documents and tool outputs.
  • Evaluate whether tool-using models can be manipulated into harmful actions.
  • Compare responses across demographic groups, names and languages to identify bias.
  • Review model responses against written safety policies and flag violations.
  • Label content as safe or unsafe per project guidelines.

Skills

Security testing
Policy analysis
Documentation
Strong written English

Tools

Burp Suite
Garak
PyRIT
OWASP LLM Top 10

Job description

Responsibilities
  • Write prompts and multi-turn conversations testing model adherence to safety guidelines
  • Try known and novel jailbreak techniques and record outcomes
  • Test for prompt injection using hidden instructions in documents and tool outputs
  • Evaluate whether tool-using models can be manipulated into harmful actions
  • Compare responses across demographic groups, names and languages to identify bias
  • Review model responses against written safety policies and flag violations
  • Label content as safe or unsafe per project guidelines
Requirements
  • 0 to 5 years of professional experience
  • Security testing, CTFs, trust and safety, content moderation or policy analysis experience
  • Experience testing systems or models by trying to break them and documenting results
  • Experience applying written policies or guidelines to label content or behavior
  • Strong written English and careful documentation habits
  • Ability to work with sensitive content under structured guidelines
    Preferred Qualifications
    • Familiarity with language model jailbreaks, prompt injection or red teaming
    • Familiarity with Burp Suite, Garak, PyRIT or the OWASP LLM Top 10
    Benefits
    • Compensation of $30 to $60 per hour, based on hours worked
    About the Company

    An expert network supporting AI model evaluation projects, matching experts to projects by background.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Safety Testing Associate
Safety Testing Associate

Clera • United States

Remote
USD 41,000 - 83,000
Fully remote
Project-matched work
Expert Talent Pool, Safety Testing Associate
Expert Talent Pool, Safety Testing Associate

Clera • United States

Remote
USD 41,000 - 83,000
Expert Talent Pool, Safety Testing (Expert)
Expert Talent Pool, Safety Testing (Expert)

Clera • United States

Remote
USD 103,000 - 241,000
Project-based pay
Fully remote work
Expert Talent Pool, Safety Testing (Expert, 5+ Years)
Expert Talent Pool, Safety Testing (Expert, 5+ Years)

Expert Talent Pool • United States

Remote
USD 140,000 - 190,000
Expert Talent Pool, Safety Testing (Expert, 5+ Years)
Expert Talent Pool, Safety Testing (Expert, 5+ Years)

Clera • United States

Remote
USD 103,000 - 241,000
Competitive hourly rate
AI Safety Testing Specialist
AI Safety Testing Specialist

Expert Talent Pool • United States

Remote
USD 41,000 - 83,000
Hourly compensation
AI Safety & Red-Team Specialist
AI Safety & Red-Team Specialist

Vettedlance • United States

Remote
USD 83,000 - 124,000
AI Jailbreak & Prompt-Injection Security Expert
AI Jailbreak & Prompt-Injection Security Expert

Micro1 • United States

Remote
USD 69,000 - 124,000
Remote work
Contractor-friendly engagement
Ai Safety Specialist - Remote | Upto $84/Hr
Ai Safety Specialist - Remote | Upto $84/Hr

Mercor • San Francisco (CA)

Hybrid
GBP 72,000 - 86,000
Ai Safety Expert - Red Teamer
Ai Safety Expert - Red Teamer

Mercor • San Francisco (CA)

Hybrid
GBP 21,000 - 23,000