Research Engineer, Assurance Evaluation

Google DeepMind; London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading company in artificial intelligence is seeking a Research Engineer to design and execute evaluations for AI systems. The role involves developing infrastructure for evaluations, collaborating with experts in AI ethics, and ensuring the safety of AI models. Candidates should have a technical degree and strong Python skills, with a keen interest in AI policy and ethics.

Qualifications

• Bachelor's degree in a technical subject or equivalent experience.
• Strong knowledge and experience of Python.

Responsibilities

• Design and develop evaluations to test the safety of AI models.
• Run evaluations prior to releases for new AI models.
• Communicate results clearly to decision-makers.

Skills

Python

Mathematics

Statistics

Machine Learning

AI Ethics

Education

Bachelor's degree in a technical subject

Tools

Data Analysis Tools

Job description

Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

About Us

Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

The Role

We’re looking for engineers who are interested in creating and executing the evaluations that we use to make release decisions for our cutting-edge AI systems.

You will apply your engineering skills to develop and maintain infrastructure and methods for reliable, repeatable evaluations, including datasets, systems to run automated and human evaluations, and analysis tools.

You will develop and maintain an understanding of the trends in AI development, governance, and sociotechnical research. Using this understanding, you will help design new evaluations, and communicate the results clearly to advise and inform decision-makers on the safety of our AI systems.

In all this work, you will work closely with other engineers and research scientists, both with researchers focused on developing AI systems and with experts in AI ethics and policy.

Key responsibilities:

• Design, develop evaluations to test the safety of cutting edge AI models.
• Develop and maintain infrastructure for these evaluations.
• Run these evaluations prior to releases for new AI models.
• Clearly communicate results to decision-makers.
• Collaborate with experts in various fields of AI ethics, policy and safety.

About You

In order to set you up for success as a Research Engineer at Google DeepMind, we look for the following skills and experience:

• Bachelor's degree in a technical subject (e.g. machine learning, AI, computer science, mathematics, physics, statistics), or equivalent experience.
• Strong knowledge and experience of Python.
• Knowledge of mathematics, statistics and machine learning concepts useful for understanding research papers in the field.
• Ability to present technical results clearly.
• A deep interest in the ethics and safety of AI systems, and in AI policy.

In addition, the following would be an advantage:

• Experience with crowd computing (e.g. designing experiments, working with human raters).
• Experience with web application development and user experience design.
• Experience with data analysis tools & libraries.
• Skill and interest in working on projects with many stakeholders.

At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.

Apply for this job

*

indicates a required field

First Name *

Last Name *

Email *

Phone

Resume/CV *

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

LinkedIn Profile

Link to external profile e.g. LinkedIn, GitHub etc.

Where did you hear about this role? * Select...

UK Demographic Questions

Google DeepMind is committed to equal opportunity employment regardless of race, religion or belief, ethnic or national origin, disability, age, citizenship, marital status, domestic or civil partnership status, sexual orientation, gender identity or any other basis as protected by applicable law. A voluntary self-identification question enables us to monitor and evaluate the effectiveness of our equal opportunities policy within our recruitment process. Your information is used in an aggregated form for these limited purposes and will not form part of your application.

Please indicate your race/ethnic group (choose all that apply) * Select...