AI Security & Control Researcher

COL Limited

London

Hybrid

NOK 1,716,000 - 3,255,000

Full time

2 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Unlimited vacation
Unlimited sick leave
Up to 6 months of paid parental leave
Comprehensive health, dental andvision
Retirement savings with employer match
Lunch, dinner, and snacks on workdays
Annual professional development budget

Job summary

Apollo Research is seeking a security & control expert to design robust threat models and control protocols for Watcher, our coding agent security product. This IC role offers significant influence over direction, with potential path to management.

You will address insider-risk, adversarial AI threats, and develop comprehensive monitoring and evaluation frameworks. The role emphasizes hands-on security research, threat modeling, and adversarial analysis in a dynamic startup-like environment.

Qualifications

  • 5+ years in security roles with hands-on technical work
  • Direct experience with security research, threat modeling or offensive security
  • Ability to read code, understand infrastructure and evaluate technical controls
  • Clear and precise written threat-model and security documentation

Responsibilities

  • Develop threat models for coding agents and insider-risk scenarios
  • Maintain and update a library of coding agent failure modes
  • Design attack trajectories for monitor development and backtesting
  • Act as security adjudicator for flagged trajectories and feed lessons into product improvements
  • Red-team and improve monitors and policies for Watcher and related tooling

Skills

Threat modeling
Security research
Structured thinking
Threat communications

Job description

THE OPPORTUNITY

THE OPPORTUNITY

Apollo Research works with most frontier AI companies (OpenAI, Anthropic, Google, Meta, Thinking Machines and others) to test their models before deployment and collaborate on fundamental scheming research. Our coding agent security product, Watcher, is deployed in production and monitors billions of agent tokens per month across engineering teams at agent-building scale-ups and enterprises.

We are looking for a security & control expert to help us design better threat models and control protocols against AI adversaries, and improve the effectiveness and security of Watcher.

This is truly a "start-up role" in the sense that you have significant say in shaping the direction of the role. This is an individual contributor role but could lead to management responsibilities eventually, if desired.

KEY RESPONSIBILITIES

Threat modeling for coding agents

  • Develop threat models for coding agents under the assumption that they could be misaligned or compromised. This includes near-term threats like AI agents leaking private internal data and long-term threats like agents sabotaging safety research.

  • Treat coding agents through the lens of insider risk: they have credentials, access to code, network access, and the ability to execute arbitrary actions, just like a malicious insider would (see Control agenda).

  • Map out kill chains and attack progressions similar to frameworks like MITRE ATT&CK, adapted for agentic AI. See e.g. the Agentic Loss-of-Control Threat Matrix for an example of a high-quality contribution.

  • Build and maintain our “coding agent security levels” which define what level of robustness Watcher provides against different categories of failure modes. These levels should be concrete, testable, and usable both internally (to guide product priorities) and externally (to communicate our security posture to customers).

Failure mode library and literature
  • Maintain our library of coding agent failure modes and keep it comprehensive, accurate, and current.

  • Stay up to date with the academic and industry literature on coding agent security, AI security, and adjacent fields (prompt injection, deception, accidental security implications, supply chain attacks on AI systems, etc.).

Attack design for monitor development
  • Design realistic attack trajectories and example exploits for monitor development and backtesting, work with the research team to ensure monitors are trained and evaluated against credible adversarial behavior.

Trajectory adjudication
  • Serve as security adjudicator for flagged trajectories. When monitors flag ambiguous agent behavior, determine whether it represents a genuine attack, a benign-but-unusual workflow, or needs deeper investigation, and feed those judgments back into monitor improvement.

Red-teaming Watcher
  • Red-team and improve Watcher's monitors and policies, document findings, and feed them into product improvement.

  • Work with the technical research staff to build adversarial test suites into the backtesting pipeline.

*This role is distinct from the AI Security Researcher role on Apollo's Infra & Security team, which threat-models Apollo's own internal systems and the agents operating on them.

REPRESENTATIVE PROJECTS

  • Develop a comprehensive coding agent threat model: Think deeply about all the ways in which coding agents could attack an organization. Compare this threat model to conventional threats from human insiders. Publish a detailed research piece describing the threat model building on existing research, e.g. from Redwood Research.

  • Improve our database of failure modes: We have an internal database of 50+ failure modes of coding agents with detailed reports for all of them. For this project, you would provide an expert view on the current state of that database and suggest improvements. In the long run, you would maintain that database and be responsible for integration of new failures.

  • Prioritize failure modes that Watcher should cover: Different parts of Watcher attempt to cover different threat models and attack strategies. Based on the results of the threat model project above, we want to ensure that each part of Watcher covers the most important failure modes in the most efficient way. For example, not all monitors require blocking capability and some failure modes might benefit from additional affordances like being able to disperse subagents.

JOB REQUIREMENTS

Must-haves
  • 5+ years in security roles in a hands-on technical capacity (not purely GRC/compliance). You need to be able to think structurally about threat modeling and failure modes. You need to be able to read code, understand infrastructure, and evaluate technical controls, not just write policies.
  • Direct experience with security research, threat modeling, or offensive security.
  • Comfortable working in a small, fast-moving team, and comfortable owning ambiguous, open-ended research questions.
  • Strong written communication this role produces threat models, security levels, and failure mode documentation that need to be clear and precise
Nice-to-haves
  • Experience with AI/ML systems security, LLM security, or AI control research. The field is young enough that deep experience here is rare, but any exposure significantly reduces ramp-up time.

  • Detection engineering, SOC, or incident analysis experience. A part of this role is judging whether flagged agent behavior is genuinely malicious, and people who have triaged real-world alerts might ramp much faster.

  • Familiarity with insider threat programs or insider risk frameworks. The mental model of "the coding agent is a potentially malicious insider" is useful for this role and someone who has worked on insider threats will pick it up faster.

  • Red teaming or offensive security background. Useful for the Watcher red-teaming responsibilities and for thinking adversarially about failure modes.

  • Formal AI safety research background. Helpful but not necessary. We need security practitioners who can learn the AI safety context, not AI safety researchers who need to learn security.

Explicitly not required
  • Management experience. This is an IC role, at least initially.
  • Specific certifications (CISSP, etc.). We care about demonstrated ability, not credentials.

BENEFITS

  • This role offers market competitive salary, equity, and competitive benefits.
  • Salary: San Francisco: $204,000 – $385,000; London: £136,000 – £258,000. We will be looking to meaningfully raise salaries soon.
  • Flexible work hours and schedule
  • Unlimited vacation
  • Unlimited sick leave
  • Up to 6 months of paid parental leave
  • Comprehensive health, dental and vision insurance
  • Retirement savings with competitive employer matching (e.g. 401(k) for US employees)
  • Lunch, dinner, and snacks are provided for all employees on workdays
  • Paid work trips, including staff retreats, business trips, and relevant conferences
  • A yearly $1,000 (USD) professional development budget
  • Relocation support and visa fees (if applicable)

LOGISTICS

  • Time Allocation: Full-time
  • Location: This is an in-person role working out of our London or San Francisco office. We offer flexible working hours and some wfh arrangements.
  • Visa sponsorship: We sponsor visas in both the UK and US. Sponsorship isn't guaranteed for every role or candidate, but if we make you an offer, we'll work with you to find the right visa route.
ABOUT THE TEAM

The product team consists of research scientists: Victor Gillioz, Monika Jotautaitė, Dmitrii Volkov; product engineers: Jeremy Neiman, Zak Walters, Zen van Riel, Srdjan Miletic and Gustavo Bicalho; and our GTM lead: Kyle Dai. Marius Hobbhahn (CEO) advises the team. Furthermore you will interact with our other SWEs and researchers, since we intend to be "our own customer" by using our products internally for our research work. You can find our full team here.

ABOUT APOLLO RESEARCH

The rapid rise in AI capabilities offers tremendous opportunities, but also presents significant risks. At Apollo Research, we're primarily concerned with risks from Loss of Control, i.e. risks coming from the model itself rather than e.g. humans misusing the AI. We're particularly concerned with deceptive alignment / scheming, a phenomenon where a model appears to be aligned but is, in fact, misaligned and capable of evading human oversight.

We work on the science of scheming, detection of scheming (e.g. building evaluations), and scheming mitigations (e.g. anti-scheming). We also work on control and monitoring research (see our scalable monitoring agenda). We work closely with many frontier AI companies, such as OpenAI, Anthropic, Google, Meta, Thinking Machines and others, e.g. to test their models and collaborate on the science of scheming. At Apollo, we aim for a culture that emphasizes truth-seeking, being goal-oriented, giving and receiving constructive feedback, and being friendly and helpful. If you're interested in more details about what it's like working at Apollo, you can find more information here.

We also build a coding agent security product called Watcher that secures agent deployments in companies. Our goal is to reduce the probability of catastrophic incidents by securing coding agents, learning about their real-world risks, and publishing our research on how to build these control systems most effectively.

Equality Statement: Apollo Research is an Equal Opportunity Employer. We value diversity and are committed to providing equal opportunities to all, regardless of age, disability, gender reassignment, marriage and civil partnership, pregnancy and maternity, race, religion or belief, sex, or sexual orientation.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Security & Control Researcher
AI Security & Control Researcher

Apolloresearch • London

Hybrid
NOK 1,716,000 - 3,255,000
Flexible work hours
Unlimited vacation
Unlimited sick leave
+7
AI Security Researcher
AI Security Researcher

COL Limited • London

On-site
NOK 1,827,000 - 2,385,000
Flexible working hours
Unlimited vacation
Relocation support and visa fees
+2
AI Security Researcher
AI Security Researcher

Apolloresearch • London

Hybrid
NOK 1,822,000 - 2,391,000
Health, dental and vision insurance
Unlimited vacation
Unlimited sick leave
+5
Product Security Engineer
Product Security Engineer

Apolloresearch • London

On-site
NOK 1,918,000 - 2,511,000
Competitive salary
Equity
Flexible hours
+6
AI Red Team Engineer
AI Red Team Engineer

Apolloresearch • London

On-site
NOK 1,539,000 - 2,019,000
Equity
Competitive benefits
Relocation and visa sponsorship
+1
Full-stack Software Engineer (Product)
Full-stack Software Engineer (Product)

Apolloresearch • London

Hybrid
NOK 1,124,000 - 1,685,000
Market competitive salary and equity
Unlimited vacation
Comprehensive health, dental andVision
+2
Security Engineer
Security Engineer

COL Limited • London

On-site
NOK 1,827,000 - 2,385,000
Unlimited vacation
Relocation and visa support
Comprehensive health insurance
+1
Security Engineer
Security Engineer

Apolloresearch • London

Hybrid
NOK 1,822,000 - 2,379,000
Competitive salary & equity
Flexible work hours
Unlimited vacation & sick leave
+2
Full-stack Software Engineer (Product)
Full-stack Software Engineer (Product)

COL Limited • London

On-site
NOK 1,890,000 - 2,474,000
Equity
Flexible hours
Unlimited vacation
+3
Forward Deployed Engineer (Product)
Forward Deployed Engineer (Product)

Apolloresearch • London

On-site
NOK 2,079,000 - 2,715,000
Flexible work hours
Unlimited vacation
Relocation support & visa sponsorship