Research Scientist, SAMBA, DeepMind

Google DeepMind; New York (NY); On-site; USD 207,000 - 300,000; Full time

Benefits offered by this job

Equity

Bonus target

Benefits

Job summary

Google DeepMind in the United States seeks a Research Scientist for the Sociotechnical Analysis of Model Behavior (SAMBA) team. You will design experiments, conduct large-scale tests, and develop measures to characterize model properties related to responsibility and safety.

You will collaborate with researchers to build frontier evaluations, publish results, and advance society-wide AI assessment and safety practices.

Qualifications

• PhD in CS, Economics, Computational Social Science, Data Science, Political Science or related field (or equivalent).
• 2 years of experience with statistical concepts, data analysis, and visualization.
• 2 years of experience with programming languages (e.g., Python, R) and libraries (Pandas, NumPy, Scikit-learn).
• 2 years of experience with AI evaluation.

Responsibilities

• Identify new research areas and questions.
• Design and conduct research and experiments.
• Develop and test new metrics and measures.
• Perform data analysis to synthesize and visualize results.
• Lead writing results for research publications.

Skills

Statistics concepts

Data analysis

Data visualization

Programming (Python/R)

AI evaluation

Education

PhD in Computer Science or related field

Tools

Pandas

NumPy

Scikit-learn

Job description

Minimum qualifications:

• PhD in Computer Science, Economics, Computational Social Science, Data Science, or Political Science or a related field, or equivalent practical experience.
• 2 years of experience with statistical concepts, data analysis, and visualization.
• 2 years of experience with programming languages (e.g., R, Python), relevant libraries (e.g., Pandas, NumPy, Scikit-learn), or other scripting languages.
• 2 years of experience with AI evaluation.

Preferred qualifications:

• Experience with or demonstrated interest in AI evaluation.
• Solid understanding of statistical concepts, and ability to perform basic data analysis and visualization
• Excellent communication and collaboration skills: an ability to effectively communicate and work with researchers from a wide variety of backgrounds in research publications, policy briefs, or presentations targeted at both technical and non-technical audiences.

About The Job

As an organization, Google maintains a portfolio of research projects driven by fundamental research, new product innovation, product contribution and infrastructure goals, while providing individuals and teams the freedom to emphasize specific types of work. As a Research Scientist, you'll setup large-scale tests and deploy promising ideas quickly and broadly, managing deadlines and deliverables while applying the latest theories to develop new and improved products, processes, or technologies. From creating experiments and prototyping implementations to designing new architectures, our research scientists work on real-world problems that span the breadth of computer science, such as machine (and deep) learning, data mining, natural language processing, hardware and software performance analysis, improving compilers for mobile platforms, as well as core search and much more. As a Research Scientist, you'll also actively contribute to the wider research community by sharing and publishing your findings, with ideas inspired by internal projects as well as from collaborations with research programs at partner universities and technical institutes all over the world. As a Research Scientist on the Sociotechnical Analysis of Model Behavior (SAMBA) team in the Responsible Research Group (R2), you will conduct research on model behaviors that impact people and society. You will conduct qualitative and quantitative research, design experiments, and develop measures to characterize model properties relevant to responsibility and safety. You will also design tools and methods for measuring the impact of AI on society, broadly defined. As one part of your work, you will collaborate closely with other Research Scientists and Research Engineers to build frontier evaluations, apply them in practice, and publish results. Artificial intelligence will be one of humanity's most transformative inventions. At Google DeepMind, we are a pioneering AI lab with exceptional interdisciplinary teams focused on advancing AI development to solve complex global challenges and accelerate high-quality product innovation for billions of users. We use our technologies for widespread public benefit and scientific discovery, ensuring safety and ethics are always our highest priority. We are pushing the boundaries across multiple domains. Our global teams offer diverse learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort. Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

Responsibilities

• Identify new research areas and questions.
• Design and conduct research and experiments.
• Develop and test new metrics and measures.
• Perform data analysis to synthesize and visualize research findings and evaluation results.
• Lead writing results for research publications.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. "See also Google's EEO Policy and EEO is the Law." If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.