Research Associate

Palisade Research

Berkeley (CA)

Hybrid

USD 100,000 - 200,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health coverage
Dental coverage
Long-term disability coverage
Unlimited PTO

Job summary

Palisade Research is hiring an early-career researcher to update and extend our existing research results. You will work with the Head of Research and the team to refine experiments, correct methodological weaknesses, and incorporate newer models and techniques into updated evaluations.

Fluency in academic English and the ability to write clearly for arXiv, blogs, and LessWrong will be essential. This role offers hybrid or in-person work in Berkeley with substantial ownership of projects.

Qualifications

  • Some research background in a technical field.
  • Strong command of academic English and ability to produce clear writeups for arXiv, blog posts, and LessWrong.
  • Basic experience with computer programming and the technical fundamentals of modern AI systems.
  • Experience running LLM experiments (prompting, evaluation, simple scaffolding or agent setups, analyzing results).
  • Careful, skeptical approach to empirical claims.

Responsibilities

  • Examine and extend experiments to look at newer models; explore variant prompts, improved scaffolding, stronger baselines; related methodological refinements.
  • Review past research for errors, quality issues, and opportunities for improvement, using frontier LLMs to assist with analysis, critique, and re-testing.
  • Engage with external work that builds on and critiques Palisade’s findings; incorporate useful ideas into updated evaluations.
  • Write and publish clear updates, corrections, and extensions (preprints, LessWrong posts).
  • Help maintain high standards of research integrity and transparency (reproducibility, clear documentation of methods and limitations).

Job description

Palisade Research is hiring an early-career researcher to help us update and extend our existing research results, and publish updated findings.

Palisade's mission is to help people and institutions build the understanding needed to avoid permanent disempowerment by strategic AI agents. We research the capabilities, motivations, and drives of frontier AI systems. Our work has included demonstrations of specification gaming, shutdown resistance, and autonomous hacking and self-replication. In addition to the research literature, our work has been cited in congressional hearings, the Wall Street Journal, MIT Technology Review, the BBC, and elsewhere.

Description

We are hiring an early-career researcher to help us update and extend our existing research results.

We have a collection of research results we’ve produced in the past, and we need your help to bring them up to date with new developments. We want to focus on finding and correcting methodological weaknesses, robustness issues, or outdated assumptions, as well as updating and expanding that research to include newer models, better techniques, and related work from the broader community.

We’ll want to publish clear, high-quality updates (on arXiv, our blog, and LessWrong), and this will require fluency with academic English and comfort writing for technical audiences.

You will work with the Head of Research and other members of the research team - the role would benefit most from someone with a track record of relevant research, who is ready to take substantial ownership of projects like this.

Responsibilities:
  • Examine and extend experiments to look at newer models; explore variant prompts, improved scaffolding, stronger baselines; related methodological refinements
  • Review past research for errors, quality issues, and opportunities for improvement, using frontier LLMs to assist with analysis, critique, and re-testing
  • Engage with external work that builds on and critiques Palisade’s findings; incorporate the useful ideas into updated evaluations.
  • Write and publish clear updates, corrections, and extensions (preprints, LessWrong posts)
  • Help maintain high standards of research integrity and transparency (reproducibility, clear documentation of methods and limitations, etc.)
Desired Qualifications:
  • Some research background in a technical field.
  • Strong command of academic English and the ability to produce clear writeups, suitable for arXiv, technical blog posts, and LessWrong.
  • Basic experience with computer programming and the technical fundamentals of modern AI systems.
  • Experience running LLM experiments (prompting, evaluation, simple scaffolding or agent setups, analyzing results).
  • Careful, skeptical approach to empirical claims.
  • Interest in the strategic capabilities, motivations, and controllability of advanced AI systems.
Details of Position:
  • Full-time, either hybrid or in-person in Berkeley, CA. Strong remote candidates will be considered.
  • Reports to the Head of Research, Ben Weinstein-Raun
  • Salary: $100k-200k, depending on location and experience
  • Benefits: Comprehensive health, dental, and long-term disability coverage; unlimited PTO
  • Equal opportunity employer.

Palisade Research is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, gender identity or expression, sexual orientation, national origin, ancestry, age, marital status, medical condition, physical or mental disability, genetic information, veteran status, or any other characteristic protected by federal, state, or local law.

Pursuant to the California Fair Chance Act and the Berkeley Fair Chance Access to Employment Ordinance, we will consider qualified applicants with arrest and conviction records.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Associate - AI Research Updates & Evaluation
Research Associate - AI Research Updates & Evaluation

Palisade Research • Berkeley (CA)

Hybrid
USD 100,000 - 200,000
Health coverage
Dental coverage
Long-term disability coverage
+1
Research Scientist
Research Scientist

Aisafety • Berkeley (CA)

Hybrid
USD 120,000 - 190,000
Catered lunch and dinner
Visa sponsorship for in-person employees
Reimbursement for work-related travel
Senior Research Engineer
Senior Research Engineer

Aisafety • Berkeley (CA)

Hybrid
USD 150,000 - 250,000
Catered lunch and dinner
Visa sponsorship for in-person employees
Work-related travel expenses covered
Researcher, Frontier Robustness
Researcher, Frontier Robustness

OpenAI • San Francisco (CA)

On-site
USD 295,000 - 500,000
Health insurance
Parental leave
401(k) plan
+2
Policy Generalist
Policy Generalist

Palisade Research • Washington

Hybrid
USD 120,000 - 140,000
National Security Expert
National Security Expert

Palisade Research • Washington

Hybrid
USD 140,000 - 180,000
Health coverage
Dental coverage
Long-term disability
+1
02 Applied Research Scientist San Francisco, CA · Full-time
02 Applied Research Scientist San Francisco, CA · Full-time

Softmax Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Research Engineer, Knowledge Team
Research Engineer, Knowledge Team

Anthropic • United States

Hybrid
USD 350,000 - 850,000
Research Lead, AI Safety & Pre-Training
Research Lead, AI Safety & Pre-Training

Ai Safety • United States

Hybrid
USD 150,000 - 230,000
Research Engineer
Research Engineer

Aisafety • Berkeley (CA)

Hybrid
USD 100,000 - 190,000
Catered lunch and dinner
Potential for remote work
Sponsorship for work-related travel