Research Engineer (AI Evaluation & Benchmarking) – Google DeepMind RE-Bench Project
About the Opportunity
We are hiring experienced Research Engineers, AI Researchers, Machine Learning Engineers, Applied Scientists, and Research Scientists to contribute to a cutting-edge AI evaluation initiative supporting the Google DeepMind RE-Bench Project.
The project focuses on developing the next generation of AI evaluation benchmarks by creating challenging, real-world research engineering tasks that assess the capabilities of advanced AI systems.
This is a unique opportunity to work on frontier AI research alongside leading researchers and help shape the future of AI evaluation.
What You'll Do
As a Research Engineer (RE) Curator, you will design, implement, and review complex, multi-step research tasks that simulate real-world machine learning and software engineering challenges.
Your responsibilities will include:
- Design challenging research engineering tasks for advanced AI systems.
- Implement solutions using Python and modern software development tools.
- Plan, execute, and analyze machine learning experiments.
- Perform statistical analysis and interpret experimental results.
- Create reproducible research workflows using Jupyter Notebook or Google Colab.
- Evaluate AI system performance through structured benchmarking and testing.
- Collaborate closely with researchers in an iterative feedback environment.
- Document findings and produce high-quality technical reports.
Required Qualifications
Education
Professional Experience
Required Technical Skills
Programming
- Strong Python programming skills
- Code debugging and software development best practices
Software Engineering
- Git version control
- Modern IDEs (VS Code, PyCharm, etc.)
- Clean, maintainable code
Machine Learning & AI
- Machine Learning fundamentals
- Model training and evaluation
- Large Language Models (LLMs)
- AI experimentation
- Prompt engineering or AI agent workflows
- Understanding of AI coding assistants is a plus
Data Science
- Data analysis and visualization
- Statistical analysis
- Data cleaning and interpretation
- Jupyter Notebook / Google Colab
Research & Experimentation
- Experimental design
- Scientific methodology
- Hypothesis testing
- Research documentation
- Analytical problem-solving
Preferred Qualifications
Candidates with experience in any of the following will be highly preferred:
- AI Evaluation
- Benchmark Development
- LLM Evaluation
- AI Red Teaming
- Reinforcement Learning (RL)
- Test Engineering
- Quality Assurance for AI systems
- Research publications in AI, ML, Data Science, or related fields
- Experience working with Research Scientists on experimental projects
What We're Looking For
The ideal candidate demonstrates:
- Strong research mindset
- Exceptional attention to detail
- Creativity in solving open-ended technical problems
- Ability to work independently with minimal supervision
- Comfort working in ambiguous, research-driven environments
- Excellent written and spoken English communication skills
Ensure you submit resume covering:
- Research experience
- Publications (if any)
- AI/ML expertise
- Python coding background
- Experience with AI evaluation, benchmarking, testing, or LLM red teaming
- Relevant research engineering or experimentation projects
Why Join?
- Work on a frontier AI research program supporting Google DeepMind.
- Contribute to the development of next-generation AI evaluation benchmarks.
- Solve challenging real-world research engineering problems.
- Collaborate with world-class AI researchers.
- Competitive hourly compensation with a flexible remote work model.