Science AI Lead: Data Strategy for Scientific LLMs

DeepMind Technologies Limited; Greater London; Sur place; GBP 157 000 - 227 000; Plein temps

Résumé du poste

Google DeepMind is expanding Gemini's frontier AI capabilities into highly specialized professional domains. We are seeking a Science Expert Lead to shape our foundational data strategy for the financial sector.

You will apply your deep domain knowledge to map complex Science workflows, identify critical areas for model enhancement, and curate the high-quality data necessary to make Gemini the ultimate AI assistant for Science professionals.

Qualifications

• Master's degree in natural science or computational science, or equivalent practical experience.
• Experience measuring the performance of Large Language Models (LLMs) or generative AI tools.
• Experience breaking down workflows into concrete tasks and evaluation rubrics.

Responsabilités

• Set the Science data strategy by mapping workflows into a use-case taxonomy and prioritizing capabilities, data coverage, and sourcing pipelines.
• Create high-quality Science data by designing tasks and rubrics and QA-ing datasets from vendors, customers, and synthetic pipelines for correctness, realism, and coverage.
• Steer data priorities using model failures by reproducing losses and stress-testing checkpoints on real workflows to identify gaps in scientific knowledge and assumptions.
• Build Science evaluations by assessing industry benchmarks to measure data strategy success and advise cross-team evaluation efforts on scientific coverage and realism.
• Scale expertise by recruiting and guiding SMEs, enforcing vendor quality, and converting expert contributions into training data.

Connaissances

LLM performance evaluation

Workflow decomposition

Cross-functional collaboration

Science-AI bridging

Formation

Master's degree in Natural Science or computational science

Description du poste

Google DeepMind is expanding Gemini's frontier AI capabilities into highly specialized professional domains. We are seeking a Science Expert Lead to shape our foundational data strategy for the financial sector.

You will apply your deep domain knowledge to map complex Science workflows, identify critical areas for model enhancement, and curate the high-quality data necessary to make Gemini the ultimate AI assistant for Science professionals.