Research Scientist, Harmful AI Manipulation Evaluations

Apart Research; San Francisco (CA); Remote; USD 140,000 - 200,000; Full time

Benefits offered by this job

Real ownership

Remote work

Travel budget

Learning budget

Job summary

Apart Research in San Francisco is seeking a Research Scientist for Manipulation Evals to design, build, and publish novel evaluations of AI harmful manipulation that inform EU AI Act enforcement. You will own the full pipeline and steer research directions with significant autonomy.

The role emphasizes hands-on evals, literature reviews, red-teaming, and fast, high-quality outputs. Strong technical writing for regulators is required; remote-friendly with EU-compatible time zones and travel

Qualifications

• Fast shipper with high-quality output.
• Hands-on evals experience with strong references.
• Peer-validated output with co-authored paper or impactful preprints.
• Empirical focus in safety-related evals/benchmarks.
• Strong Python and software engineering skills for eval frameworks.

Responsibilities

• Own the full pipeline from risk scoping to eval execution.
• Design novel evaluation methods for AI manipulation.
• Perform literature reviews and track state-of-the-art evals.
• Red-team results and scan transcripts for manipulation patterns.
• Deliver new results weekly with autonomous direction setting.
• Communicate technical results clearly for regulator use and public deliverables.
• Co-author papers, benchmark releases, and technical reports for EU AI Office.
• Consolidate public manipulation benchmarks into a single index.
• Develop a multilingual benchmark extension validated by native speakers.
• Contribute methodological innovations and identify better evaluation approaches.
• Draft risk scenarios that scope new evals.

Skills

Coding with agents

Eval frameworks

Python

Data analysis

Technical writing

Red-teaming

Empirical safety work

Tools

Inspect eval framework

LLM APIs

Job description

Apart Research in San Francisco is seeking a Research Scientist for Manipulation Evals to design, build, and publish novel evaluations of AI harmful manipulation that inform EU AI Act enforcement. You will own the full pipeline and steer research directions with significant autonomy.

The role emphasizes hands-on evals, literature reviews, red-teaming, and fast, high-quality outputs. Strong technical writing for regulators is required; remote-friendly with EU-compatible time zones and travel