Senior Research Scientist/Engineer, Deception

Far Ai

Oregon

Hybrid

USD 120,000 - 170,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

FAR.AI in the United States (Berkeley-based) is seeking an experienced research scientist/engineer to partner with the Deception team lead. You'll drive research projects from proposal to implementation across multiple tasks and teams, with emphasis on deception detection and monitoring.

The role focuses on detecting deception, monitoring deployed models, and training for honesty. You will mentor staff, collaborate with lab safety teams, and help translate results into practical methods for

Qualifications

  • 3+ years of experience implementing post-training or related efforts in frontier AI.
  • Hands-on post-training models at scale (RL/RLHF/RLVR) or large fine-tuning runs.
  • Strong Python and PyTorch in large shared codebases.
  • Strong research judgement to select experiments and assess results.
  • Based in US time zones; Berkeley in-person preferred.

Responsibilities

  • Lead research projects on deception detection, real-time monitoring, and training against probes.
  • Run post-training and RL experiments on large models, diagnose instability and issues.
  • Design model organisms to stress-test methods against realistic failure cases.
  • Mentor Members of Technical Staff to strengthen research judgment.
  • Collaborate with infrastructure to run large post-training jobs on FAR.AI compute cluster.
  • Ensure reproducible code, evaluations, and practical guidance for lab safety teams.
  • Write and present findings for research papers and the AI safety community.

Skills

Post-training models
RL/RLHF/RLVR
Python
PyTorch
Research judgement
Berkeley on-site

Education

PhD preferred

Job description

About Us

FAR.AI is a non-profit AI research institute working to ensure advanced AI is safe and beneficial for everyone. Our mission is to facilitate breakthrough AI safety research, advance global understanding of AI risks and solutions, and foster a coordinated global response. Since our founding in July 2022, we've grown to 50+ staff , published 40+ academic papers , and convened leading AI safety events . Our work is recognized globally, with publications at premier venues such as NeurIPS, ICML including a Best Paper Honorable Mention in 2026 , and ICLR, and features in the Financial Times , Nature News , Wired Magazine and MIT Technology Review . We conduct pre-deployment testing on behalf of frontier developers such as OpenAI, independent evaluations for governments including the EU AI Office , and publish the AI Security Leaderboard based on our red-teaming expertise. We help steer and grow the AI safety field through developing research roadmaps with renowned researchers such as Yoshua Bengio; running FAR.Labs , an AI safety-focused co-working space in Berkeley housing 40+ members; and supporting the community through targeted grants to technical researchers.

About the team

We explore promising research directions in AI safety and scale up only those showing a high potential for impact. When an approach proves effective, we develop it into a minimum viable demonstration and work with AI developers and governments to support real-world adoption.

Our recent and ongoing research includes:

  • Mitigating AI deception: studying when lie detectors induce honesty or evasion , and developing approaches to state of the art falsehood detectors and sandbagging.
  • Red-teaming: conducting pre- and post-release adversarial evaluations of frontier models (e.g. Claude 4 Opus , ChatGPT Agent , GPT-5 ); developing novel attacks to support this work.
  • Evals: developing evaluations for new threat models, e.g. persuasion and tampering risks , and launching a new research agenda on eval awareness
  • Applied Interpretability : using interpretability to tackle concrete safety problems (better probes, backdoor detection, deception monitoring), aiming for fast feedback loops, often in collaboration with our other pods.
  • Adversarial Robustness: working to rigorously solve security problems through building a science of security and robustness for AI, from demonstrating superhuman systems can be vulnerable , to scaling laws for robustness and jailbreaking constitutional classifiers .
  • Mechanistic Interpretability: finding issues with Sparse Autoencoders, probing deception using AmongUs , understanding learned planning in SokoBan, and interpretable data attribution.
About the Role

We are looking for an experienced research scientist/engineer to partner with the Research Lead of the Deception team. You'll lead research projects from initial proposal to implementation, with scope to contribute across multiple projects and teams. The team works on the following directions:

  • Detecting deception. Developing white-box probes to identify deception from internal activations, assess failure modes, compare with black-box monitors, and study the effects of self-rationalization.
  • Monitoring deployed models. Turning probes into real-time monitors with low false-positive rates, minimal overhead, and reliability across tasks and model versions.
  • Training for honesty. Using probes as a training signal and testing whether models become more honest or simply better at concealing deception.

We've shown results on an experimental scale, and the next step is scaling them up to a level where frontier labs can adopt them. In addition to providing research judgement, you'll lead that scaling work and help turn results into methods other teams can use.

What you'll do
  • Lead research projects on various timescales on white-box deception detection, probe-based monitoring, and training against probes. Responsibilities include defining research questions, setting milestones, choosing experiments, and assessing the quality of results.
  • Run post-training and RL experiments on large models, including RLVR and fine-tuning with probe-based penalties; diagnose training instability, reward hacking, and infrastructure failures.
  • Design model organisms that stress-test methods against realistic failure cases.
  • Mentor Members of Technical Staff to strengthen research judgment and experimental rigor.
  • Partner with the infrastructure team to plan and run large post-training jobs on FAR.AI's compute cluster.
  • Enable frontier labs to adopt the team's methods through reproducible code, clear evaluations, practical guidance, and direct collaboration with lab safety teams.
  • Write and present findings for research papers, frontier lab partners, and the broader AI safety community.
Requirements
  • 3+ years experience with implementing post-training, model training, or closely related efforts in a frontier AI environment
  • Hands-on experience post-training models at scale (RL, RLHF/RLVR or large fine-tuning runs), ideally on models of 400B+ parameters.
  • Strong Python and PyTorch, and experience working in large, shared research codebases.
  • Strong research judgement to know what experiments to run next and to recognize when a result needs further scrutiny.
  • Based in or willing to work in U.S. time zones. In person in Berkeley is preferred.

If you meet most of this and not all of it, we encourage you to apply anyway.

Additional skills we're excited about
  • Real depth in one or more of these makes you a compelling candidate: Safety or alignment research at a frontier lab or a research lab working on large models (1T+ parameters)
  • Experience with interpretability or white-box methods (e.g probes, steering or SAEs)
  • Experience building model organisms of misalignment, or studying reward hacking, scheming or evaluation awareness.
  • Publications at top ML venues (NeurIPS, ICML, ICLR) or widely cited technical reports.
  • A PhD in a relevant field.
Logistics
  • Location: Both remote within U.S. time zones and in-person (Berkeley, CA) are possible. We sponsor visas for in-person employees.
  • Hours: Full-time (40 hours/week).
  • Application process: 1 short intake call with a technical recruiter, 1 30 minute screening call with the Head of Engineering, a 60 min ML assessment, a 60 min code review interview, a team fit assessment with the hiring manager, and a paid work trial lasting up to 1 week. If you are not available for a work trial we may be able to find alternative ways of testing your fit.

If based in the USA or Singapore, you will be an employee of FAR.AI (501(c)(3) research non-profit / non-profit CLG). Outside the USA or Singapore, you will be employed via an EOR organisation on behalf of FAR.AI or as a contractor.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Research Scientist / Engineer, Deception
Senior Research Scientist / Engineer, Deception

AISafety • Berkeley (CA)

Hybrid
USD 180,000 - 260,000
Health insurance
Senior Research Scientist/Engineer, Deception
Senior Research Scientist/Engineer, Deception

FAR.AI • Berkeley (CA)

Hybrid
USD 150,000 - 210,000
Senior Research Scientist/Engineer, Deception
Senior Research Scientist/Engineer, Deception

FAR.AI • United States

Hybrid
USD 225,000 - 350,000
Research Engineer
Research Engineer

Aisafety • Berkeley (CA)

Hybrid
USD 100,000 - 190,000
Catered lunch and dinner
Potential for remote work
Sponsorship for work-related travel
Research Scientist
Research Scientist

Aisafety • Berkeley (CA)

Hybrid
USD 120,000 - 190,000
Catered lunch and dinner
Visa sponsorship for in-person employees
Reimbursement for work-related travel
Technical Program Manager, Research
Technical Program Manager, Research

FAR.AI • Berkeley (CA)

Hybrid
USD 120,000 - 190,000
Health Insurance
401(k) match
PTO 25 days/yr
+3
Research Lead
Research Lead

Far Ai • Berkeley (CA)

Remote
USD 290,000 - 450,000
Health Insurance
401(k) plan with up to 2% match
PTO - 25 days per year, with paid sick
+1
Research Lead
Research Lead

Far Ai • Berkeley (CA)

Hybrid
USD 150,000 - 210,000
Health Insurance
Retirement - 401(k) plan with up to 2%
PTO - 25 days Paid Time Off per year
+3
Research Lead
Research Lead

Far Ai • United States

Hybrid
USD 290,000 - 450,000
Health Insurance
401(k) plan
25 days PTO per year
+1
Research Lead - Pre-training Safety
Research Lead - Pre-training Safety

FAR.AI • Berkeley (CA)

On-site
USD 180,000 - 240,000