Research Scientist, Frontier Risk Evaluations San Francisco, CA Apply →

Scale AI, Inc.; New York (NY); On-site; USD 90,000 - 130,000; Full time

Job summary

Scale AI, Inc. is searching for a Research Scientist to join Scale Labs, focusing on frontier AI risks and policy research. This role involves designing tests for AI model vulnerabilities, collaborating with government entities, and publishing methodologies to guide policymakers. Candidates should have a commitment to safe AI development and experience in technical research, machine learning, and effective communication.

Preferred qualifications include experience in crafting evaluations related to AI technologies and familiarity with AI safety policies. The position offers an inclusive workplace committed to equal opportunity.

Qualifications

• Commitment to promoting safe, secure, and trustworthy AI deployments.
• Experience in conducting collaborative technical research and building ML pipelines.
• At least three years of experience in addressing sophisticated ML problems.

Responsibilities

• Design and build harnesses to test AI models and systems for dangerous capabilities.
• Work with government agencies to design evaluations measuring AI risk.
• Publish evaluation methodologies and write technical reports for policymakers.

Skills

Technical research experience

Machine learning pipelines

Research publication track record

Strong communication skills

Job description

Scale Labs, Research Scientist — Frontier Risk Evaluations

As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs has launched a new team focused on policy research to bridge the gap between AI research and global policymakers, enabling informed, scientific decisions about AI risks and capabilities.

Our research tackles the hardest problems in agent robustness, AI control protocols, and AI risk evaluations to help governments, industry, and the public understand and mitigate AI risk while maximizing AI adoption. This team collaborates broadly across industry, the public sector, and academia and regularly publishes our findings. We are actively seeking talented researchers to join us in shaping this vision.

Job Responsibilities

• Design and build harnesses to test AI models and systems (including agents) for dangerous capabilities such as security vulnerability exploitation, CBRN uplift, and other high-risk activities.
• Work with government agencies or other labs to collectively scope and design evaluations to measure and mitigate risks posed by advanced AI systems.
• Publish evaluation methodologies and write technical reports for policymakers.

Qualifications

• Commitment to our mission of promoting safe, secure, and trustworthy AI deployments as frontier AI capabilities continue to advance.
• Practical experience conducting technical research collaboratively, building and instrumenting ML pipelines, writing evaluation harnesses, and turning research literature into working prototypes.
• A track record of published research in machine learning, particularly in generative AI.
• At least three years of experience addressing sophisticated ML problems, whether in a research setting or in product development.
• Strong written and verbal communication skills to operate in a cross‑functional team.

Nice to Have

• Experience crafting evaluations and benchmarks, or a background in data science roles related to LLM technologies.
• Experience with red‑teaming or adversarial testing of AI systems.
• Familiarity with AI safety policy frameworks (e.g., NIST AI RMF, EU AI Act, Korea AI Basic Act).

Equal Employment Opportunity

We believe that everyone should be able to bring their whole selves to work, and we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity, Veteran status, or any other protected characteristic.

We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at [e-mail].

We comply with the United States Department of Labor's Pay Transparency provision.

We collect, retain and use personal data responsibly for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. Please see our privacy policy for additional information.