Research Scientist, AI Evaluation & Sociotechnical Analysis

Google LLC; New York (NY); On-site; USD 207,000 - 300,000; Full time

Job summary

Google DeepMind in New York, NY, USA is seeking a Share Research Scientist on the SAMBA team to study model behavior and socio-technical impacts. You will design evaluations, conduct experiments, and publish results with researchers from diverse backgrounds.

You will collaborate with Research Scientists and Engineers to build frontier evaluations, apply them in practice, and contribute to safety and ethics in AI at scale.

Qualifications

• PhD or equivalent practical experience.
• 5 years of experience with statistical concepts, data analysis, and visualization.
• 5 years of experience with programming languages (R, Python) and libraries.
• 2 years of experience with AI evaluation.
• 2 years of experience working with industry codebases.

Responsibilities

• Identify new research areas and questions.
• Design and conduct research and experiments.
• Develop and test new metrics and measures.
• Perform data analysis to synthesize and visualize research findings and evaluation results.
• Lead writing results for research publications.

Skills

Statistics concepts

Data analysis & visualization

Programming (R/Python)

AI evaluation

Industry codebases

Education

PhD in Computer Science, Economics or related field

Tools

Pandas

NumPy

Scikit-learn

Job description

Google DeepMind in New York, NY, USA is seeking a Share Research Scientist on the SAMBA team to study model behavior and socio-technical impacts. You will design evaluations, conduct experiments, and publish results with researchers from diverse backgrounds.

You will collaborate with Research Scientists and Engineers to build frontier evaluations, apply them in practice, and contribute to safety and ethics in AI at scale.