AI Research Scientist: Frontier STEM Benchmarks

Turing; Palo Alto, San Francisco, Seattle (CA, CA, WA); On-site; USD 150,000 - 300,000; Full time

Benefits offered by this job

Equity

Job summary

Turing seeks exceptional AI Research Scientists to develop new benchmarks, datasets, and evaluation methods for frontier AI systems, focusing on STEM evaluation, synthetic data, hallucination, and reliability.

You will identify gaps in literature, propose ambitious research directions, and lead projects from hypothesis through experimentation to publication, collaborating with frontier labs and enterprises.

Qualifications

• PhD or equivalent research experience in machine learning, computer science, mathematics, physics, chemistry, biology, engineering, statistics, or another highly technical field.
• Demonstrated ability to formulate and execute original research.
• Strong understanding of modern LLMs and the frontier AI research landscape.
• Excellent experimental design, quantitative reasoning, and scientific judgment.
• Ability to rapidly understand unfamiliar technical literature and develop expertise in new areas.
• Strong Python skills and the ability to independently build research prototypes and evaluation pipelines.
• Excellent technical writing and communication.
• Comfort working in a fast-moving environment where the research agenda evolves with the frontier.

Responsibilities

• Frontier benchmarks and evaluation: identify gaps, design novel benchmarks, develop evaluations for emerging model capabilities, build robust methodologies.
• Synthetic data and post-training: develop methods for generating high-quality synthetic STEM training data and study data quality effects.
• Hallucination, reliability, and verification: study epistemic failure, reliability, and verification techniques, enabling accurate attribution and abstention.
• Agentic science: research AI systems capable of long-horizon scientific work and collaboration with humans and agents.

Skills

Python

Research design

Experimentation

Technical writing

LLMs knowledge

Literature review

Education

PhD or equivalent in ML/CS/Math/Physics/Engineering

Job description

Turing seeks exceptional AI Research Scientists to develop new benchmarks, datasets, and evaluation methods for frontier AI systems, focusing on STEM evaluation, synthetic data, hallucination, and reliability.

You will identify gaps in literature, propose ambitious research directions, and lead projects from hypothesis through experimentation to publication, collaborating with frontier labs and enterprises.