Head of Safety

Cognition AI

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

11 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cognition AI in San Francisco is seeking a senior Safety/Alignment lead to build the safety function for Devin. You will shape the research agenda, evaluation, red-teaming, and deployment policies, working closely with researchers and engineers.

This hands-on role requires frontier-lab safety experience, deep understanding of agentic systems, and a track record shipping mitigations. You will hire and lead safety researchers, represent Cognition AI with customers and the broader research

Qualifications

  • Frontier lab safety or alignment experience with real-model impact.
  • Agentic systems depth: understanding failure modes in deployed agents.
  • Research credibility: published or widely used safety research or evals.
  • Technical fluency: comfortable with Python and ML stacks.
  • Builder, not reviewer: shipping mitigations over memos.
  • Judgment under uncertainty: clear deployment risk calls.

Responsibilities

  • Own safety end to end: set Devin safety strategy and outcomes.
  • Build the evaluation program: design evals and red-teaming for risk.
  • Shape training and the agent harness: integrate safety into training and usage.
  • Set deployment policy: define allowed actions and governance with enterprise.
  • Build the team and the external voice: hire leads and represent Cognition AI externally.

Skills

Frontier lab safety experience
Agentic systems depth
Research credibility
Python proficiency
Builder mindset
Judgment under uncertainty

Education

Advanced degree in Computer Science / ML or related field

Job description

We are an applied AI lab building end-to-end software agents.

We're the makers of Devin, the first AI software engineer.

Our team is extremely talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro.

Building Devin is just the first step—our hardest challenges still lie ahead. If you’re excited to solve some of the world’s biggest problems and build AI that can reason on real-world tasks, apply to join us.

Role Mission

Devin is one of the most capable autonomous agents in production. It writes and runs code, uses tools, takes actions in real customer systems, and operates for hours without a human in the loop. That makes it one of the most important places in the industry to get safety right, and one of the few where safety work ships to millions of developers rather than staying in a paper. You will build Cognition's safety function from the ground up: the research agenda, the evaluation and red-teaming program, the deployment policies, and the team. You will work directly with the researchers training our models and the engineers building the agent harness. This is a hands-on role for someone who has done serious safety or alignment work at a frontier lab and wants to apply it where agents actually operate.

What You'll Accomplish
  • Own safety end to end: Set the safety strategy for Devin and the models behind it, and own the outcomes.

  • Build the evaluation program: Design evals and red-teaming for agentic risk: unsafe actions, prompt injection, data exfiltration, sandbox escape, reward hacking, and misuse. Make them part of every model and product release.

  • Shape training and the agent harness: Partner with pre-training, post-training, and agent teams so safety is built into how models are trained and how Devin plans, acts, and asks for help.

  • Set deployment policy: Define what Devin is and is not allowed to do, how permissions and oversight work, and how we handle the gray areas, in a way that holds up with enterprise customers.

  • Build the team and the external voice: Hire and lead safety researchers and engineers. Represent Cognition's safety work with customers, policymakers, and the broader research community.

Exceptional Candidates Have Demonstrated
  • Frontier lab safety or alignment experience: Hands-on work on safety, alignment, evaluations, or red-teaming at a frontier AI lab. You have shipped safety work that affected real models or products.

  • Agentic systems depth: You understand how agents fail in practice: tool misuse, specification gaming, long-horizon drift, adversarial inputs. You have ideas about how to measure and mitigate it.

  • Research credibility: A track record of published or widely used safety research, evals, or methods. An advanced degree in Computer Science, Machine Learning, or a related field is a plus.

  • Technical fluency: Comfortable in Python and in the training and inference stack. You can read the code, run the evals, and argue with researchers on the details.

  • Builder, not reviewer: You have started or scaled a safety function and prefer shipping mitigations to writing memos about them.

  • Judgment under uncertainty: You can make clear calls on deployment risk with incomplete information and explain them to engineers, executives, and customers.

Equal Opportunity

Cognition is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected characteristic under applicable law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the hiring process - please let us know if you need any.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer, Safety & Alignment
Research Engineer, Safety & Alignment

Cognition • San Francisco (CA)

On-site
USD 210,000 - 260,000
Software Engineer, Infrastructure
Software Engineer, Infrastructure

Cognition • Buffalo (NY)

On-site
USD 260,000 - 300,000
Private chef
Cozy slippers
Endless snacks
Security Engineer
Security Engineer

Cognition • San Francisco (CA)

On-site
USD 260,000 - 300,000
Private chef
Cozy slippers
Endless snacks
Member of Technical Staff, AI Safety
Member of Technical Staff, AI Safety

Trajectory Labs • Berkeley (CA)

Hybrid
USD 250,000 - 400,000
Health coverage
401(k)
Food: Catered meals and snacks
+1
Tech Lead, AI Safety
Tech Lead, AI Safety

Trajectory Labs • Berkeley (CA)

Hybrid
USD 250,000 - 400,000
Health coverage
401(k)
Food: Catered meals & snacks
+1
Deployed Engineer - EMEA
Deployed Engineer - EMEA

Cognition • Logan (WV)

On-site
USD 90,000 - 130,000
Research Engineer, Post-Training
Research Engineer, Post-Training

cognition • San Francisco (CA)

On-site
USD 150,000 - 210,000
Lead Safety Architect for Autonomous AI Agents
Lead Safety Architect for Autonomous AI Agents

Cognition AI • San Francisco (CA)

On-site
USD 180,000 - 240,000
Researcher, Agent Safety, Training and Evaluations
Researcher, Agent Safety, Training and Evaluations

Precision Labs • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Relocation assistance
Autonomous Agent Safety & Alignment Engineer
Autonomous Agent Safety & Alignment Engineer

Cognition • San Francisco (CA)

On-site
USD 210,000 - 260,000