GenAI Research Engineer - Model Evaluations & Multi-Agent AI

Google Inc.; Cambridge (MA); On-site; USD 174,000 - 252,000; Full time

Job summary

Google DeepMind in Cambridge, MA is seeking a Research Engineer focused on GenAI for information tasks. You will develop evaluations, hillclimb model quality, and collaborate with product teams to ensure scalable AI solutions align with research goals.

Applicants should have a Bachelor's in CS/ML or related field and at least 3 years of Python/C++ software development experience, with proficiency in ML frameworks such as PyTorch, TensorFlow, or JAX.

Qualifications

• Bachelor's degree in Computer Science, Machine Learning, a related technical field, or equivalent practical experience.
• 3 years of experience with software development in Python or C++.
• Experience with ML frameworks (e.g., PyTorch, TensorFlow, JAX), crafting model evaluations and hillclimbing model performance.

Responsibilities

• Build rigorous evaluations to systematically measure model performance across various workloads and drive continuous quality hillclimbing.
• Develop modular, adaptable solutions that enable seamless integration across multiple Google product areas.
• Collaborate cross-functionally with Eng, PM, and Data Science partners to translate product requirements and feedback into model quality improvements.

Skills

Python

C++

PyTorch

TensorFlow

JAX

Education

Bachelor's degree

Job description

Google DeepMind in Cambridge, MA is seeking a Research Engineer focused on GenAI for information tasks. You will develop evaluations, hillclimb model quality, and collaborate with product teams to ensure scalable AI solutions align with research goals.

Applicants should have a Bachelor's in CS/ML or related field and at least 3 years of Python/C++ software development experience, with proficiency in ML frameworks such as PyTorch, TensorFlow, or JAX.