GenAI Research Engineer — LLM & Model Evaluation

Google Inc.

Cambridge, Northern (MA, KY)

Hybrid

USD 174,000 - 252,000

Full time

22 hours ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Google DeepMind is seeking a Research Engineer focused on GenAI, info task, and large-scale evaluation. You will design experiments, implement scalable models, and drive model quality improvements across product areas.

You’ll work closely with engineering, research, and product teams to translate requirements into robust model evaluations. The role emphasizes cross-functional leadership, experimentation, and collaboration to advance AI-technologies at Google scale, with a focus on responsible,

Qualifications

  • Bachelor's degree in Computer Science, Machine Learning, a related technical field, or equivalent practical experience.
  • 3 years of experience with software development in Python or C++.
  • Experience with ML frameworks (e.g., PyTorch, TensorFlow, JAX), crafting model evaluations and hillclimbing model performance.

Responsibilities

  • Build rigorous evaluations to systematically measure model performance across various workloads and drive continuous quality hillclimbing.
  • Develop modular, adaptable solutions that enable seamless integration across multiple Google product areas.
  • Collaborate cross-functionally with Eng, PM, and Data Science partners to translate product requirements and feedback into model quality improvements.

Skills

Python
C++
ML frameworks

Education

Bachelor's degree in Computer Science or related field

Tools

PyTorch
TensorFlow
JAX

Job description

Google DeepMind is seeking a Research Engineer focused on GenAI, info task, and large-scale evaluation. You will design experiments, implement scalable models, and drive model quality improvements across product areas.

You’ll work closely with engineering, research, and product teams to translate requirements into robust model evaluations. The role emphasizes cross-functional leadership, experimentation, and collaboration to advance AI-technologies at Google scale, with a focus on responsible,

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

GenAI Research Engineer: Evaluations & Hillclimb
GenAI Research Engineer: Evaluations & Hillclimb

Socket.dev • Cambridge (MA)

On-site
USD 174,000 - 252,000
Equity
Bonus plan (15% target)
Benefits
Staff AI Engineer — LLM & Agent Evaluation
Staff AI Engineer — LLM & Agent Evaluation

Socket.dev • Mountain View (CA)

On-site
USD 207,000 - 300,000
Research Engineer, GenAI, Info Task, DeepMind
Research Engineer, GenAI, Info Task, DeepMind

Socket.dev • Cambridge (MA)

On-site
USD 174,000 - 252,000
Equity
Bonus plan (15% target)
Benefits
Research Engineer — AI Evaluation & Agent Orchestration
Research Engineer — AI Evaluation & Agent Orchestration

Google DeepMind • Mountain View (CA)

On-site
USD 174,000 - 252,000
Research Engineer, ML Metrics & Model Serving
Research Engineer, ML Metrics & Model Serving

Google DeepMind • Mountain View (CA)

On-site
USD 174,000 - 252,000
GenAI Evaluation Scientist: LLM Benchmarks & Diagnostics
GenAI Evaluation Scientist: LLM Benchmarks & Diagnostics

Scale AI • San Francisco (CA)

On-site
USD 166,000 - 207,000
Health coverage
Equity
Retirement benefits
+3
GenAI Evaluation Scientist - LLM Benchmarks & Failures
GenAI Evaluation Scientist - LLM Benchmarks & Failures

Scale • San Francisco (CA), Seattle (WA), New York (NY)

On-site
USD 166,000 - 207,000
Health insurance
Dental coverage
Vision coverage
+2
Research Engineer, GenAI, Info Task, DeepMind
Research Engineer, GenAI, Info Task, DeepMind

Google Inc. • Cambridge (MA)

On-site
USD 174,000 - 252,000
GenAI Evaluations Lead: Benchmarking & Failure Diagnostics
GenAI Evaluations Lead: Benchmarking & Failure Diagnostics

Scale AI • United States

On-site
USD 181,000 - 226,000
Staff Research Engineer, Applied AI, DeepMind
Staff Research Engineer, Applied AI, DeepMind

Google Inc. • Mountain View (CA)

On-site
USD 207,000 - 300,000
Equity
Bonus target