Science AI Strategy Lead

Google LLC; New York, Mountain View (NY, CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google DeepMind in New York and Mountain View seeks a Science Expert Lead to shape Gemini’s data strategy and map complex science workflows for model improvement.

You will curate high-quality data and rubrics, collaborate with researchers to prioritize capabilities, and drive data quality across vendors and synthetic pipelines. This senior role offers equity and a bonus target in addition to base compensation.

Qualifications

• Master's degree in natural science or equivalent practical experience.
• Experience measuring the performance of large language models (LLMs) or generative AI tools and optimizing them for scientific use cases.

Responsibilities

• Set the Science data strategy by mapping workflows into a use-case taxonomy and partnering with research to prioritize capabilities, data coverage, and sourcing pipelines.
• Create high-quality Science data by designing tasks and rubrics, and QA-ing datasets from vendors, customers, and synthetic pipelines for correctness, realism, and coverage.
• Steer data priorities using model failures by reproducing reported losses and stress-testing checkpoints on real workflows to identify missing scientific knowledge and false assumptions.
• Build Science evaluations by assessing industry benchmarks to measure data strategy success, and advise cross-team evaluation efforts on scientific coverage and realism.
• Scale expertise by recruiting and guiding SMEs, acting as the domain authority to enforce vendor quality, and converting expert contributions into usable training data.

Skills

LLM evaluation

Workflow breakdown

Cross-functional collaboration

ML model evaluation

Education

Master's degree or equivalent

Job description

Google DeepMind in New York and Mountain View seeks a Science Expert Lead to shape Gemini’s data strategy and map complex science workflows for model improvement.

You will curate high-quality data and rubrics, collaborate with researchers to prioritize capabilities, and drive data quality across vendors and synthetic pipelines. This senior role offers equity and a bonus target in addition to base compensation.