AI Benchmarking & Strategy Lead

Artificial Analysis

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity
Competitive compensation

Job summary

Artificial Analysis, based in San Francisco, is hiring a Member of Technical Staff to design evaluations that set the standard for how AI is measured and to work with leading AI labs and enterprises.

You’ll develop benchmarking methodologies, manage relationships with top AI labs, and help drive product direction. The role blends product, research, and client-facing work for those who enjoy breadth and ownership.

Qualifications

  • 3+ years of relevant professional experience.
  • Proficiency in Python and data analysis.
  • Genuine, demonstrable interest and knowledge of Frontier AI.
  • Strong analytical and critical thinking skills.

Responsibilities

  • AI Benchmarking Product Development: structure, design and execute projects to evaluate AI systems and technologies.
  • Strategic Analysis of AI: drive reports and data visualizations to communicate complex AI concepts to enterprises.
  • Partner with Leading AI Companies: collaborate with leading AI companies to support benchmarking of technologies and improve the platform.
  • Become AI-Native: embrace an AI-native workflow and use cutting-edge AI tools to maintain our competitive edge.
  • Company Strategy: contribute to company strategy and drive large initiatives to scale the business.

Skills

Python
Data analysis
Analytical thinking
Coding skills
Frontier AI knowledge

Job description

Artificial Analysis, based in San Francisco, is hiring a Member of Technical Staff to design evaluations that set the standard for how AI is measured and to work with leading AI labs and enterprises.

You’ll develop benchmarking methodologies, manage relationships with top AI labs, and help drive product direction. The role blends product, research, and client-facing work for those who enjoy breadth and ownership.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Member of Technical Staff, AI Benchmarking
Senior Member of Technical Staff, AI Benchmarking

Artificial Analysis, Inc. • San Francisco (CA)

On-site
USD 100,000 - 150,000
Competitive compensation including equity
Opportunity to shape AI development
Robotics Lead, Member of Technical Staff — AI Benchmarking
Robotics Lead, Member of Technical Staff — AI Benchmarking

Artificial Analysis • San Francisco (CA)

On-site
USD 180,000 - 260,000
Equity compensation
Competitive compensation
Robotics Benchmarking Lead — Member of Technical Staff
Robotics Benchmarking Lead — Member of Technical Staff

Artificial Analysis, Inc. • San Francisco (CA)

On-site
USD 120,000 - 160,000
Equity
Competitive compensation
Influence on AI development
AI Hardware Product Manager - Benchmarking & Strategy
AI Hardware Product Manager - Benchmarking & Strategy

Artificial Analysis • San Francisco (CA)

On-site
USD 150,000 - 210,000
Equity
Hardware Benchmarking Engineer – AI Accelerators
Hardware Benchmarking Engineer – AI Accelerators

Artificial Analysis, Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Equity
AI Speech Product Manager & Benchmarking Lead (Equity)
AI Speech Product Manager & Benchmarking Lead (Equity)

Artificial Analysis, Inc. • San Francisco (CA)

On-site
USD 100,000 - 150,000
Competitive compensation including equity
Exposure to leading AI labs
AI Benchmark Architect—Systems & GPUs
AI Benchmark Architect—Systems & GPUs

Sandisk • California (MO)

On-site
USD 120,000 - 160,000
Comprehensive benefits package
Paid vacation and sick leave
Employee Stock Purchase Plan
AI Hardware Product Manager: Benchmarking & Silicon
AI Hardware Product Manager: Benchmarking & Silicon

Artificial Analysis, Inc. • San Francisco (CA)

On-site
USD 100,000 - 150,000
Competitive compensation including equity
Opportunity to shape AI innovation
Work with leading experts in AI
AI Benchmarks & Evaluations Program Manager
AI Benchmarks & Evaluations Program Manager

Mercor • San Francisco (CA)

On-site
USD 120,000 - 200,000
Performance bonus structure
Equity grant
$15K relocation bonus
+7
Frontier AI Strategy Consultant (Commercial)
Frontier AI Strategy Consultant (Commercial)

Artificial Analysis • San Francisco (CA)

On-site
USD 150,000 - 190,000