Senior Staff AI Safety Engineer - Agents

Cohere; Greater London; On-site; GBP 120,000 - 150,000; Full time

Job summary

Cohere is seeking a Member of Technical Staff in Safety for Agents to advance safe and trustworthy LLMs. You’ll focus on data generation, post-training algorithms, and evaluation methods to improve safety when LLMs access external resources and take actions in the world.

You will work with machine learning, ethics, and policy teams in a highly autonomous team, contributing to the next generation of AI that serves society responsibly.

Responsibilities

• Data generation and evaluation for Safety in LLMs.
• Collaborate with cross-functional ML, data annotation, product and policy teams.
• Design experiments and implement post-training algorithms for safer, more trustworthy models.

Job description

Cohere is seeking a Member of Technical Staff in Safety for Agents to advance safe and trustworthy LLMs. You’ll focus on data generation, post-training algorithms, and evaluation methods to improve safety when LLMs access external resources and take actions in the world.

You will work with machine learning, ethics, and policy teams in a highly autonomous team, contributing to the next generation of AI that serves society responsibly.