Research Associate in Detecting Unverbalized Dangerous Capabilities in Frontier Models

Independent

Greater London

Hybrid

GBP 51,000 - 59,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

43 days off per year
Generous pension schemes
World-leading institution

Job summary

Imperial College London invites applications for a Postdoctoral Research Associate in the Safety & Alignment lab led by Dr. Oana-Maria Camburu. The funded role focuses on detecting unverbalized dangerous capabilities in frontier models and monitoring chain-of-thought reasoning.

You will design algorithms, conduct independent and collaborative research, mentor PhD/MSc students, and publish in NeurIPS, ICML, ICLR, ACL and related venues. The position starts ASAP for 12 months.

Qualifications

  • PhD in CS/Math/Physics or related discipline or equivalent research/industrial experience.
  • Publications in refereed journals/conferences (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP, TACL, AIJ).
  • Experience with frontier models and deep learning libraries such as PyTorch.

Responsibilities

  • Design and develop algorithms for detecting unverbalized dangerous capabilities in frontier models.
  • Conduct independent and collaborative research within the group.
  • Publish results in top-tier conferences and journals (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP, AIJ, TACL).
  • Implement research ideas.
  • Contribute to research projects involving frontier models.
  • Participate in lab activities such weekly meetings and presentations.
  • Mentor PhD and MSc students.

Skills

Research skills
Model checking
Monitoring
CoT reasoning
PyTorch

Education

PhD in Computer Science, Mathematics, Physics or related

Tools

PyTorch

Job description

About the role:

We are seeking a motivated Postdoctoral Research Associate to join the Safety&Alignment lab led by Dr. Oana-Maria Camburu in a fully funded research role.

The position is fully funded in the context of Dr. Oana-Maria Camburu’s grant on the project Detecting Unverbalized Dangerous Capabilities in Frontier Models. The project focuses on the detection of frontier model’s dangerous capabilities that are not verbalized in their Chain-of-Thoughts (CoTs). Externalized reasoning oversight is a safety paradigm focusing on monitoring the CoTs of large language models (LLMs). As frontier models learn that they are monitored, they can become incentivized to hide their dangerous capabilities from their CoTs. Moreover, as these models become increasingly capable, their obfuscation capabilities also increase, allowing them to bypass monitors. This project investigates ways to detect and defend against such emerging scenarios.

What you would be doing:

We strive in publishing in top-tier conferences and journals. Some areas you will work on are:

  • Designing and developing novel algorithms for detecting and defending against unverbalized dangerous capabilities in frontier models.
  • Conducting independent and collaborative research within the group.
  • Publishing results in top-tier conferences and journals (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP, AIJ, TACL, etc).
  • Implementing research ideas.
  • Contributing to research projects involving frontier models.
  • Contributing to the life and development of the Safety & Alignment lab, such weekly meetings, presentations, etc.
  • Mentoring PhD and MSc students.
What we are looking for:

Candidates should have, or expect shortly to obtain, a PhD in Computer Science, Mathematics, Physics or a closely related discipline, or equivalent research/industrial experience. You will have practical experience within a research environment and publications in relevant and refereed journals/conferences, such as NeurIPS, ICML, ICLR, ACL, EMNLP, TACL, AIJ, etc as well as experience in a broad range of techniques including model checking, monitoring, and CoT. Research experience in frontier models and in coding with deep learning libraries such as Pytorch is also essential.

Please see job description for a full list of requirements.

What we can offer you:
  • The opportunity to continue your career at a world-leading institution and be part of our mission to continue science for humanity.
  • Grow your career: gain access to Imperial’s sector-leading dedicated career support for researchers as well as opportunities for promotion and progression.
  • Sector-leading salary and remuneration package (including 43 days off a year and generous pension schemes).
  • Be part of a diverse, inclusive and collaborative work culture with various staff networks and resources to support your personal and professional wellbeing.
Further Information

Full-time, fixed term for 12 months to start ASAP and before 8th April 2027.

*Candidates who have not yet been officially awarded their PhDwill be appointed as Research Assistant within the salaryrange£45,399- £48,876per annum.

Informal enquiries related to the position should be directed to Dr

Oana-Maria Camburu o.camburu@imperial.ac.uk

For queries regarding the application process contact Jamie Perrins:

j.perrins@imperial.ac.uk

Closing Date: 22nd November 2026 (midnight)

£50,733 to £59,484 per annum

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Associate in Detecting Unverbalized Dangerous Capabilities in Frontier Models
Research Associate in Detecting Unverbalized Dangerous Capabilities in Frontier Models

Imperial Enterprise • Greater London

On-site
GBP 45,000 - 59,000
Career support for researchers
Salaries above market
Generous pension
+1
Frontier AI Safety Researcher: Detecting Capabilities
Frontier AI Safety Researcher: Detecting Capabilities

Independent • Greater London

Hybrid
GBP 51,000 - 59,000
43 days off per year
Generous pension schemes
World-leading institution
Research Associate: Detecting Hidden Dangers in Frontier AI
Research Associate: Detecting Hidden Dangers in Frontier AI

Imperial Enterprise • Greater London

On-site
GBP 45,000 - 59,000
Career support for researchers
Salaries above market
Generous pension
+1
Postdoctoral Researcher: AI Safety in Mental Health
Postdoctoral Researcher: AI Safety in Mental Health

Independent • Oxford

Hybrid
GBP 39,000 - 48,000
Flexible hybrid working
Research Associate in Dexterous Manipulation and Robot Learning
Research Associate in Dexterous Manipulation and Robot Learning

Imperial College London • Greater London

On-site
GBP 45,000 - 49,000
43 days off a year
State-of-the-art hardware
Travel & dissemination support
Postdoctoral Research Associate
Postdoctoral Research Associate

University of Liverpool • Liverpool

On-site
GBP 40,000 - 46,000
Postdoctoral Research Associate
Postdoctoral Research Associate

UAG • Liverpool

Hybrid
GBP 40,000 - 46,000
Postdoctoral Researcher: AI Safety in Mental Health
Postdoctoral Researcher: AI Safety in Mental Health

University-of-Oxford • Oxford

Hybrid
GBP 40,000 - 50,000
Contributory pension
38 days annual leave
Childcare services
+2
Researcher, Frontier Risk Mitigations
Researcher, Frontier Risk Mitigations

OpenAI • Greater London

On-site
GBP 218,000 - 328,000
[Expression of Interest] Research Engineer / Scientist, Alignment - London
[Expression of Interest] Research Engineer / Scientist, Alignment - London

Anthropic • Greater London

On-site
GBP 260,000 - 370,000
Competitive compensation
Generous vacation and parental leave
Flexible working hours
+1