AI Safety Research Engineer - RL Environments & Alignment

Confero; San Francisco (CA); Hybrid; USD 200,000 - 300,000; Full time

Job summary

Confero in San Francisco is seeking a Research Engineer, AI Safety / Alignment to join a hybrid team working three days in the office. You will design and build evaluation environments and RL-style tests to study how frontier models behave when optimized for the wrong objective.

You will own projects end to end, from scenarios to agents and graders, and contribute to infrastructure that runs and evaluates these experiments.

Qualifications

• Strong generalist software engineering ability with Python preference.
• At least 1 year of professional software engineering experience.
• Genuine interest in AI alignment and reducing existential risk.
• Strong analytical and conceptual reasoning.
• Comfortable owning ambiguous technical projects end to end.

Responsibilities

• Design and build evaluation and RL-style environments to test frontier models for reward hacking.
• Own research projects end to end: developing scenarios, building environments, directing agents, iterating graders, analyzing behavior.
• Contribute to shared infrastructure used to create, run and evaluate these environments.

Skills

Python

Software engineering

Analytical thinking

Project ownership

AI alignment interest

Tools

RL frameworks

Job description

Confero in San Francisco is seeking a Research Engineer, AI Safety / Alignment to join a hybrid team working three days in the office. You will design and build evaluation environments and RL-style tests to study how frontier models behave when optimized for the wrong objective.

You will own projects end to end, from scenarios to agents and graders, and contribute to infrastructure that runs and evaluates these experiments.