Cybersecurity Expert, AI Agent Evaluation

Workada

United States

Remote

USD 138,000 - 207,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work from US/Canada
Weekly payouts via Stripe
Interview with field expert

Job summary

Workada is seeking security experts to craft hands-on AI tasks that can run in a Linux terminal, using your own research or practice as the seed for each challenge.

You will write briefs, prepare environments with necessary tools, build reference solutions, and implement automated verification for each task. Strong emphasis on offensive/defensive security and real-world edge cases.

Qualifications

  • PhD in computer security, CS, mathematics, or 5+ years security experience.
  • Comfort with Linux terminal: shell commands, Python or Bash scripting, installing packages.
  • Experience with Docker; templates and worked examples provided.

Responsibilities

  • Convert problems from your work into self-contained tasks for an AI agent to solve in a Linux terminal.
  • Write a clear brief for each task and set up the environment with required files and tools.
  • Build reference solutions and write automated checks on final results.

Skills

Linux terminal
Python scripting
Bash scripting
Adversarial thinking
Technical writing
Docker

Education

PhD in computer security / CS / mathematics
5+ years security experience

Tools

Docker
Ghidra
IDA
Burp Suite
Wireshark
Volatility
pwntools

Job description

Put your security expertise to work at the frontier of AI.

Bring the expertise you know best and help train AI agents that do real technical work, on your own schedule, from anywhere. You'll turn problems from your own research or professional practice into hands‑on challenges that an AI agent has to solve at the command line. You'll find exactly where it breaks and set the expert standard it's measured against. Workada connects skilled contributors with meaningful AI work, and your judgment is what makes that work reliable. We're building a community of security experts, both PhDs and seasoned practitioners, to test how far today's AI agents can go on real problems in offensive and defensive security. We'd like you to be part of it.

What you'll do

You'll take problems from your own work and turn each one into a self‑contained task that an AI agent has to solve in a Linux terminal. For every task, you'll do four things:

  • Write a clear brief.
  • Set up the environment with the files and tools the agent needs.
  • Build a reference solution.
  • Write automated checks on the final result.

The strongest tasks are the ones today's best agents still get wrong. Your firsthand knowledge of where real security work goes wrong is what makes them valuable. That might be a padding oracle in a homegrown protocol, a stripped binary hiding its real logic, a forensic timeline that doesn't add up, or an auth bypass in a web app.

Specialties we're looking for

If your background is in offensive and defensive security, there's likely a place for you. We're building depth across:

  • Cryptography: applied cryptography, protocol analysis, and cryptanalysis
  • Reverse engineering: binary analysis, malware analysis, and firmware
  • Forensics: disk, memory, and network forensics, and incident response
  • AppSec: web and API security, secure code review, and penetration testing
Who we're looking for

Academics and practitioners are equally welcome. No AI or machine‑learning background is needed. We're after your security expertise and your comfort working in a terminal.

Requirements
  • You hold, or are completing, a PhD in computer security, computer science, mathematics, or a closely related field, or you have 5+ years of professional experience in security.
  • You've done technical or computational work in your field and are comfortable in a Linux terminal: shell commands, scripting in Python or Bash, and installing packages.
  • You've used Docker, or can pick it up quickly. We share templates and worked examples.
  • You can draw on your own research, projects, code, or files as source material for your tasks.
  • You have a precise, adversarial eye and enjoy finding the exact point where a workflow breaks, then explaining it cleanly.
  • You're honest about uncertainty and write instructions that leave no room for misreading.
  • You're based in the US or Canada.
  • Experience with Ghidra, IDA, Burp Suite, Wireshark, Volatility, or pwntools, or CTF experience is a plus.
Materials you can use

Almost any part of your technical work can seed a task. For example:

  • Scripts, code, and pipelines from your research or practice
  • Binaries, packet captures, and disk or memory images
  • Service configurations, logs, and code you've reviewed
  • Datasets and the processing behind them
  • Bugs, edge cases, and failure modes you've had to debug yourself
What we offer
  • $100 to $150 per hour, based on your field and experience
  • Weekly payouts through Stripe
  • Remote work from anywhere in the US or Canada
  • Real people to work with: a 30‑minute interview with someone in your field, and a Lead you can reach when questions come up

We're building this group now for projects starting in the coming weeks. If you're a match, we'll share the start date for your field as soon as we have it. We won't ask you to hold time before work is ready.

Workada is an Equal Opportunity Employer. We welcome applicants from all backgrounds.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Security Engineer – AI Agent Evaluation
Security Engineer – AI Agent Evaluation

Workada • United States

Remote
USD 120,000 - 180,000
MTS - Research (Cybersecurity)
MTS - Research (Cybersecurity)

Collinear AI, Inc. • Sunnyvale (CA)

On-site
USD 140,000 - 190,000
Cybersecurity Defense Expert
Cybersecurity Defense Expert

Alignerr • United States

Remote
USD 96,000 - 193,000
Artificial Intelligence Researcher (Cybersecurity) - PhD
Artificial Intelligence Researcher (Cybersecurity) - PhD

Stealth AI Startup • San Francisco (CA)

On-site
USD 120,000 - 180,000
AI Security Testing Specialist
AI Security Testing Specialist

Alignerr Corp. • United States

Remote
USD 83,000 - 124,000
Application Security Analyst
Application Security Analyst

Alignerr Corp. • Atlanta (GA)

Remote
USD 55,000 - 110,000
Fully remote
Flexible schedule
Global collaboration
Cybersecurity Penetration Testing Expert
Cybersecurity Penetration Testing Expert

Alignerr Corp. • New York (NY)

Remote
USD 83,000 - 152,000
Application Security Analyst
Application Security Analyst

Alignerr Corp. • Seattle (WA)

Remote
USD 83,000 - 124,000
Application Security Analyst
Application Security Analyst

Alignerr Corp. • New York (NY)

Remote
USD 55,000 - 110,000
Fully remote
Flexible schedule
Security Engineer - AI Agent Task Architect
Security Engineer - AI Agent Task Architect

Workada • United States

Remote
USD 120,000 - 180,000