AI Benchmarking & Strategy Lead

Artificial Analysis

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Competitive compensation

Job summary

Artificial Analysis, based in San Francisco, is hiring a Member of Technical Staff to design evaluations that set the standard for how AI is measured and to work with leading AI labs and enterprises.

You’ll develop benchmarking methodologies, manage relationships with top AI labs, and help drive product direction. The role blends product, research, and client-facing work for those who enjoy breadth and ownership.

Qualifications

  • 3+ years of relevant professional experience.
  • Proficiency in Python and data analysis.
  • Genuine, demonstrable interest and knowledge of Frontier AI.
  • Strong analytical and critical thinking skills.

Responsibilities

  • AI Benchmarking Product Development: structure, design and execute projects to evaluate AI systems and technologies.
  • Strategic Analysis of AI: drive reports and data visualizations to communicate complex AI concepts to enterprises.
  • Partner with Leading AI Companies: collaborate with leading AI companies to support benchmarking of technologies and improve the platform.
  • Become AI-Native: embrace an AI-native workflow and use cutting-edge AI tools to maintain our competitive edge.
  • Company Strategy: contribute to company strategy and drive large initiatives to scale the business.

Skills

Python
Data analysis
Analytical thinking
Coding skills
Frontier AI knowledge

Job description

Artificial Analysis, based in San Francisco, is hiring a Member of Technical Staff to design evaluations that set the standard for how AI is measured and to work with leading AI labs and enterprises.

You’ll develop benchmarking methodologies, manage relationships with top AI labs, and help drive product direction. The role blends product, research, and client-facing work for those who enjoy breadth and ownership.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Member of Technical Staff, AI Benchmarking
Senior Member of Technical Staff, AI Benchmarking

Artificial Analysis, Inc. • San Francisco (CA)

On-site
USD 100,000 - 150,000
Competitive compensation including equity
Opportunity to shape AI development
Senior AI Benchmarking & Systems Architect
Senior AI Benchmarking & Systems Architect

Aionia Group • San Francisco (CA)

On-site
USD 130,000 - 220,000
Equity
On-site
AI Hardware Product Manager - Benchmarking & Strategy
AI Hardware Product Manager - Benchmarking & Strategy

Artificial Analysis • San Francisco (CA)

On-site
USD 150,000 - 210,000
Equity
AI Speech Product Manager & Benchmarking Lead (Equity)
AI Speech Product Manager & Benchmarking Lead (Equity)

Artificial Analysis, Inc. • San Francisco (CA)

On-site
USD 100,000 - 150,000
Competitive compensation including equity
Exposure to leading AI labs
AI Hardware Product Manager: Benchmarking & Silicon
AI Hardware Product Manager: Benchmarking & Silicon

Artificial Analysis, Inc. • San Francisco (CA)

On-site
USD 100,000 - 150,000
Competitive compensation including equity
Opportunity to shape AI innovation
Work with leading experts in AI
AI Benchmarks & Evaluations Program Manager
AI Benchmarks & Evaluations Program Manager

Mercor • San Francisco (CA)

On-site
USD 120,000 - 200,000
Performance bonus structure
Equity grant
$15K relocation bonus
+7
AI Evaluation Architect — Frontier Benchmarks & Systems
AI Evaluation Architect — Frontier Benchmarks & Systems

Handshake • Mountain View (CA)

On-site
USD 200,000 - 350,000
Ownership: Equity
401(k) match
Parental leave
+6
Frontier AI Strategy Consultant (Commercial)
Frontier AI Strategy Consultant (Commercial)

Artificial Analysis • San Francisco (CA)

On-site
USD 150,000 - 190,000
Staff AI Benchmark Architect
Staff AI Benchmark Architect

Vals AI, Inc. • San Francisco (CA)

On-site
USD 150,000 - 230,000
Relocation support
Health/dental insurance
Lunch and dinner provided
+2
Member of Technical Staff
Member of Technical Staff

Artificial Analysis, Inc. • San Francisco (CA)

On-site
USD 100,000 - 150,000
Competitive compensation including equity
Opportunity to shape AI development