Founding GTM

OpenFunnel (YC F24)

San Francisco (CA)

On-site

USD 90,000 - 130,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

OpenBenchmarks is the evaluation infrastructure for agents—domain-specific, reproducible benchmarks that help agents pick tools with confidence. Benchmarks are how companies market their products to agents, and turning that nuance into clear content is a core part of this role.

You’ll run benchmarks, query the data, and build graphs that show trade-offs like precision versus latency. You’ll craft the findings into posts and reports, and ensure the writing reaches both professional audiences and

Qualifications

  • Background in statistics, engineering or data science.
  • Working knowledge of search engine optimization (SEO).
  • Taste and opinions on great design.

Responsibilities

  • Create benchmarks content, findings and visuals.
  • Develop data visualizations illustrating trade-offs.
  • Distribute content to professionals and agents.

Skills

Statistics
Engineering
Data Science
SEO
Design

Tools

Claude Code
Claude Design

Job description

About OpenBenchmarks

Agents are becoming first-class users and consumers of the internet. They research, evaluate, compare tools and increasingly make build-versus-buy decisions on behalf of people. Every company will need to get their products picked and used by agents.

Agents increasingly prefer open, independent and grounded benchmarks to make decisions.

Openbenchmarks is the evaluation infrastructure for agents - domain-specific, reproducible evaluations that help agents pick tools with confidence.

Our mission is to be the trusted evaluation layer for agents.

Founders previously led AI research and Infra teams at Oracle and Appfolio; we started Openbenchmarks as an output of our research in the field of model behavior and how agents actually chose between different tools.

We're a team of researchers, engineers and work with the fastest growing AI first companies like Parallel, Firecrawl, Telnyx, TinyFish and more.

About The Role

Benchmarks are how companies market their products to agents. We build those benchmarks.

There's a lot of nuance in every benchmark - what gets evaluated, which metrics matter, release cycles, data refreshes. A benchmark isn't static, and a changing benchmark constantly surfaces new insight into how the tools on it actually perform. Turning that into content - posts, graphs, chart is super important to communicate the nuance of the benchmark in the most clear way possible.

That's your job.

Here are the broad themes that you'll be working on.

Content from benchmarks

You'll run benchmarks, query the data, and dig into individual failures to find what's actually there - where a vendor is strong and why, what the failure mode of the field is, what the trade-off costs. You use that to create content: the finding, graphs and more, and what we're changing in v2. Doing the digging deeply yourself is what makes the writing credible.

Data visualization and Graphs

The graphs & charts are how the trade-offs are shown. Precision against latency, F1 against cost etc. You'll design and build these yourself using Claude Code, Claude Design.

Distribution to people and agents

We have two audiences.

People on LinkedIn, X, and HN. And the agents that read, index, and cite it when someone asks which tool to pick. You'll own how the work gets found by both - which means the writing has to be genuinely, because slop doesn't survive either audience.

Knowing & the benchmark landscape

You know what benchmarks already exist - SWE-bench, Terminal-bench, BrowseComp, continuously understand the leaderboards vendors cite in their launch posts - and be able to say precisely where they're saturated, where they're gamed, and where the gap is that we should fill. You'll bring proposals for what we benchmark next, and the case for why it matters.

Preferred
  • Background in Statistics, Engineering or Data Science
  • Working Knowledge of Search Engine Optimization
  • Have taste and opinions on great design vs bad design.
  • Working Knowledge of Claude Code, Claude Design or creating data visualizations that stand out.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Benchmarks Storyteller
Benchmarks Storyteller

OpenFunnel (YC F24) • San Francisco (CA)

On-site
USD 120,000 - 180,000
Founding GTM & Benchmark Content Lead
Founding GTM & Benchmark Content Lead

OpenFunnel (YC F24) • San Francisco (CA)

On-site
USD 90,000 - 130,000
Research Engineer, Benchmarks
Research Engineer, Benchmarks

HUD • San Francisco (CA)

On-site
USD 140,000 - 190,000
Competitive compensation
Top-tier medical, dental, and vision (
Lunch and dinner in office
+5
Research Engineer - Benchmarks
Research Engineer - Benchmarks

Firecrawl • San Francisco (CA)

Hybrid
USD 250,000 - 290,000
Competitive salary
Equity
PTO
+5
Research Scientist, Open Benchmarks Red Team
Research Scientist, Open Benchmarks Red Team

snorkelai • United States

Remote
USD 120,000 - 180,000
Benchmark Insight Engineer
Benchmark Insight Engineer

present of AI • United States

On-site
USD 90,000 - 150,000
Founding GTM
Founding GTM

Keenable.ai, Inc. • San Francisco (CA)

On-site
USD 180,000 - 280,000
Frontier AI infrastructure work
High autonomy with real production问题
Meaningful compute access
+4
AI Benchmark & Datasets Engineer / Researcher
AI Benchmark & Datasets Engineer / Researcher

Pathway • Palo Alto (CA)

Remote
USD 150,000 - 210,000
Intellectually stimulating work environment
Work with a pioneering AI startup
Flexible remote work options
Founding Growth Marketer
Founding Growth Marketer

Mintive • San Mateo (CA)

On-site
USD 120,000 - 180,000
Early-stage equity
AI Strategist
AI Strategist

Unusual • San Francisco (CA)

On-site
USD 90,000 - 130,000
Research-driven insights
Collaborative team environment
Innovative role development