Frontier Engagements Lead — AI Research & Model Evaluations

Aperio Talent Solutions

San Francisco (CA)

On-site

USD 160,000 - 260,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Aperio Talent Solutions is partnering with a rapidly growing AI company to hire a Frontier Engagements Lead in San Francisco. This research-driven role focuses on shaping how top AI labs assess model quality, data requirements, and evaluation methodologies.

You'll translate complex research into actionable proposals, collaborate with technical and commercial teams, and help establish a new function with scalable processes, while working onsite five days a week.

Qualifications

  • Frontier AI laboratory or AI evaluation organization experience.
  • At least 1 year hands-on studying model behavior / LLM evaluations.
  • Ability to investigate why AI models succeed or fail across tasks and user scenarios.
  • Strong foundation in ML, LLMs, and evaluation methodologies.
  • Proficiency in Python and ML research/evaluation tools.
  • Exceptional written communication skills and ability to translate findings into proposals.
  • Strong presentation and interpersonal skills for communicating with researchers.
  • Independent, well-reasoned perspectives on model quality and reliability.
  • Ability to work onsite in San Francisco five days per week.

Responsibilities

  • Evaluate AI model behavior and provide research-backed perspectives on effectiveness across applications.
  • Analyze model performance, strengths, weaknesses, failure modes, and reasoning across various agents and chatbots.
  • Develop research-driven proposals, analyses, and materials for researchers at AI labs.
  • Collaborate with internal technical and commercial teams to identify opportunities and develop data-driven solutions.
  • Engage frontier AI researchers and establish the organization as a trusted research partner.
  • Influence AI development through recommendations on evaluation, data strategies, and model improvements.
  • Help build and standardize research methodologies and scalable processes within a new team.

Skills

Frontier AI research
Python
Model evaluation
Communication
Independent thinking
Onsite SF

Education

CS/ML/Stats degree

Job description

About the Opportunity

We are partnering with a rapidly growing, well-funded AI company at the forefront of advancing large language models (LLMs) and autonomous AI agents.

The company develops sophisticated datasets, evaluation methodologies, and data infrastructure that help leading AI research laboratories improve model reasoning, behavior, and performance.

We are seeking a Frontier Engagements Lead to join a newly established, research-focused commercial function. This is a unique opportunity for an AI researcher or technical specialist who wants to expand their influence beyond a single model or research organization.

Rather than focusing exclusively on internal research, you'll help shape how leading AI laboratories think about model quality, evaluations, and the data required to build more capable AI systems.

This is not a traditional sales position. It is a research-driven role requiring deep technical expertise, intellectual curiosity, exceptional communication skills, and the ability to translate complex research into actionable recommendations.

What You'll Do
  • Evaluate AI Model Behavior: Develop informed, research-backed perspectives on what makes LLMs and AI agents effective across different applications, users, and environments.
  • Analyze Model Performance: Investigate model strengths, weaknesses, failure modes, reasoning capabilities, and answer quality across personal assistants, enterprise agents, and general-purpose chatbots.
  • Develop Research-Driven Proposals: Translate technical insights into compelling proposals, analyses, presentations, and supporting materials for researchers at leading AI laboratories.
  • Collaborate with Technical and Commercial Teams: Work closely with internal stakeholders to identify research opportunities, understand customer challenges, and develop solutions grounded in model evaluation and data quality.
  • Engage Frontier AI Researchers: Progressively participate in technical discussions with researchers, helping establish the organization as a trusted research partner rather than simply a data provider.
  • Influence AI Development: Contribute perspectives and recommendations that can inform model evaluation, training data strategies, and improvements across multiple frontier AI organizations.
  • Build a New Function: Help establish research methodologies, technical communication standards, and scalable processes within a newly formed team.
What We're Looking For
Required Qualifications
  • Professional experience at a frontier AI laboratory, emerging AI research organization, or company specializing in AI evaluations, datasets, or model development.
  • At least one year of hands-on experience studying model behavior, interpretability, post-training, LLM evaluations, or answer quality. Exceptional candidates with shorter, highly relevant frontier AI experience will also be considered.
  • Demonstrated ability to investigate how and why AI models succeed or fail across different tasks and user scenarios.
  • Strong technical foundation in machine learning, large language models, and experimental evaluation methodologies.
  • Proficiency in Python and experience working with ML research or evaluation tools.
  • Exceptional written communication skills, including the ability to translate sophisticated technical findings into clear, persuasive research proposals.
  • Strong presentation and interpersonal skills, with the confidence to discuss complex technical concepts with experienced AI researchers.
  • Independent, well-reasoned perspectives on model quality, reliability, usefulness, and performance.
  • Ability to work onsite in San Francisco five days per week.
Preferred Qualifications
  • Experience contributing to AI benchmarks, evaluation frameworks, datasets, or model assessment projects.
  • Hands-on experience with model interpretability, alignment, reinforcement learning, reward modeling, or post-training methodologies.
  • Experience evaluating agentic systems, complex reasoning capabilities, or model performance across different user populations.
  • Familiarity with human annotation programs, expert evaluation pipelines, or data quality initiatives.
  • Experience with AI-assisted development tools such as Claude Code or Codex.
  • A degree in Computer Science, Machine Learning, Statistics, Mathematics, Economics, Data Analytics, or a related technical discipline. Equivalent hands-on experience will also be considered.
  • Demonstrated experience communicating technical research findings to audiences outside an immediate research team.
Who Will Thrive in This Role

You may be an excellent fit if you:

  • Have strong opinions about what makes an AI model genuinely useful, reliable, or effective—and can explain why.
  • Enjoy investigating model behavior and developing creative ways to measure performance.
  • Are equally comfortable conducting technical analysis and communicating its implications to others.
  • Want your research perspectives to influence multiple leading AI laboratories rather than a single organization’s models.
  • Thrive in fast-moving environments with significant autonomy and ownership.
  • Are excited about helping build a new function from the ground up.
  • Enjoy collaborating with talented researchers, engineers, and commercial teams to solve difficult technical problems.
Why Join?

Influence the Future of AI

Contribute to research conversations and evaluation strategies that can influence how multiple frontier AI laboratories develop and improve their models.

Collaborate with Leading AI Researchers

Gain exposure to diverse perspectives on model behavior, reasoning, evaluations, and data from some of the most advanced AI research organizations.

Combine Research with Strategic Impact

Apply your technical expertise beyond traditional research settings, helping transform sophisticated findings into meaningful partnerships and real-world AI improvements.

Build Something from the Ground Up

Join a newly established function with meaningful ownership, autonomy, and opportunities to help shape its long-term direction.

Join a High-Growth AI Organization

Work alongside a highly technical, ambitious team developing infrastructure and datasets that support the next generation of AI systems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Frontier Engagements Lead
Frontier Engagements Lead

Premier Global Links LLC • San Francisco (CA)

On-site
USD 200,000 - 300,000
Relocation support for qualified
Competitive equity opportunity
Opportunity to help build a new AI-eng
+1
Frontier Engagements Lead
Frontier Engagements Lead

Premier Global Links • San Francisco (CA)

On-site
USD 200,000 - 300,000
Relocation support
Equity opportunity
On-site SF office
AI Research Engineer
AI Research Engineer

Cerebro • San Francisco (CA)

On-site
USD 270,000 - 330,000
Equity
Applied Research Engineer
Applied Research Engineer

HRB • San Francisco (CA)

On-site
USD 180,000 - 280,000
Member of Technical Staff (Applied AI Research)
Member of Technical Staff (Applied AI Research)

FDE Times • San Francisco (CA)

On-site
USD 180,000 - 260,000
Equity
On-site in SF
Member of Technical Staff (Language Model Evaluations)
Member of Technical Staff (Language Model Evaluations)

Artificial Analysis • San Francisco (CA)

On-site
USD 180,000 - 260,000
Equity
Applied Research Engineer
Applied Research Engineer

Nxt Level • San Francisco (CA)

On-site
USD 180,000 - 280,000
Forward Deployed Engineer - Language Models
Forward Deployed Engineer - Language Models

FDE Times • San Francisco (CA)

On-site
USD 150,000 - 230,000
Equity
Frontier Agents Engineer (Applied AI) Software
Frontier Agents Engineer (Applied AI) Software

Frontdoor Defense • New York (NY)

On-site
USD 180,000 - 225,000
Forward Deployed Engineer - Language Models
Forward Deployed Engineer - Language Models

Artificial Analysis, Inc. • United States

Hybrid
USD 140,000 - 210,000
Equity