Research Engineer, Assurance Evaluation Engineering London, UK

DeepMind Technologies Limited; London; On-site; GBP 60,000 - 100,000; Full time

Job summary

An innovative firm is seeking a Research Engineer to advance AI safety through rigorous evaluations. In this role, you will design and develop evaluation methods, maintain infrastructure for testing AI models, and collaborate with experts in AI ethics and policy. This position offers the chance to work at the forefront of AI technology, ensuring that safety and ethical considerations are integral to development. Join a diverse team dedicated to using AI for public benefit and contribute to shaping the future of artificial intelligence.

Qualifications

• Bachelor's degree in a technical field or equivalent experience.
• Strong proficiency in Python and understanding of AI concepts.

Responsibilities

• Design and develop evaluations to test the safety of advanced AI models.
• Communicate evaluation results to decision-makers clearly.

Skills

Python

Mathematics

Machine Learning

Statistics

AI Ethics

Education

Bachelor's degree in a technical field

Tools

Data Analysis Tools

Job description

Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

About Us

Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

The Role

We’re looking for engineers interested in creating and executing evaluations to inform release decisions for our cutting-edge AI systems.

You will develop and maintain infrastructure and methods for reliable, repeatable evaluations, including datasets, automated and human evaluation systems, and analysis tools.

You will stay informed about trends in AI development, governance, and sociotechnical research. Using this knowledge, you will help design new evaluations and communicate results clearly to advise decision-makers on AI safety.

You will collaborate closely with engineers, research scientists, and experts in AI ethics and policy.

Key responsibilities:

1. Design and develop evaluations to test the safety of advanced AI models.
2. Develop and maintain infrastructure for these evaluations.
3. Conduct evaluations prior to AI model releases.
4. Communicate evaluation results to decision-makers clearly.
5. Collaborate with experts in AI ethics, policy, and safety.

About You

To succeed as a Research Engineer at Google DeepMind, you should have:

• A Bachelor's degree in a technical field (e.g., machine learning, AI, computer science, mathematics, physics, statistics) or equivalent experience.
• Strong proficiency in Python.
• Understanding of mathematics, statistics, and machine learning concepts relevant to research papers.
• Ability to communicate technical results effectively.
• A keen interest in AI ethics and safety, and AI policy.

Additional advantageous skills include:

• Experience with crowd computing (e.g., designing experiments, working with human raters).
• Web application development and user experience design experience.
• Experience with data analysis tools and libraries.
• Ability to work on projects involving multiple stakeholders.

At Google DeepMind, we value diversity and are committed to equal employment opportunity regardless of background or identity. If you require accommodations, please let us know.