Benchmark Insight Engineer

present of AI

United States

On-site

USD 90,000 - 150,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Openbenchmarks is seeking a rigorous evaluator to turn raw benchmark outputs into reports that withstand expert scrutiny. You will ground conclusions in solid statistics, design evaluations, and clear technical writing, and you will craft honest, reproducible charts in code.

You will identify the real findings in messy results, explain failures rather than conceal them, and communicate results to technical audiences. This role offers the chance to shape how AI tools are compared and interpreted.

Qualifications

  • Solid statistics background demonstrated in benchmarks.
  • Experience designing and running evaluations for AI tools.
  • Ability to communicate results with technical clarity.

Responsibilities

  • Turn raw benchmark outputs into rigorous reports.
  • Ensure results are controlled, tested and reproducible.
  • Identify real findings in messy results and explain failures.

Skills

Statistics
Evaluation design
Technical writing
Data visualization in code
Reproducible charts
Mixed effects modeling

Job description

Openbenchmarks is seeking a rigorous evaluator to turn raw benchmark outputs into reports that withstand expert scrutiny. You will ground conclusions in solid statistics, design evaluations, and clear technical writing, and you will craft honest, reproducible charts in code.

You will identify the real findings in messy results, explain failures rather than conceal them, and communicate results to technical audiences. This role offers the chance to shape how AI tools are compared and interpreted.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Benchmarks Storyteller
Benchmarks Storyteller

present of AI • United States

On-site
USD 90,000 - 150,000
Benchmarks Storyteller
Benchmarks Storyteller

OpenFunnel (YC F24) • San Francisco (CA)

On-site
USD 120,000 - 180,000
Benchmark Storyteller: Stats, Graphs & Clear Reports
Benchmark Storyteller: Stats, Graphs & Clear Reports

OpenFunnel (YC F24) • San Francisco (CA)

On-site
USD 120,000 - 180,000
Benchmarking Engineer for AI in Finance
Benchmarking Engineer for AI in Finance

Ramp • San Francisco (CA)

On-site
USD 150,000 - 200,000
Flexible PTO
Home-office equipment ordering
Health and wellness stipend
+2
Senior Benchmarking Engineer, Performance & Competition
Senior Benchmarking Engineer, Performance & Competition

Elastic • United States

Hybrid
USD 140,000 - 200,000
Competitive pay
Health coverage
Flexible locations
+4
AI Benchmarking & Performance Architect
AI Benchmarking & Performance Architect

Coreweave • Sunnyvale (CA)

On-site
USD 206,000 - 333,000
Medical, dental, and vision insurance
Equity awards
401(k) with match
+2
AI Benchmarking Engineer
AI Benchmarking Engineer

Wipro Limited • San Diego (CA)

On-site
USD 60,000 - 149,000
Medical and dental benefits
Disability insurance
Paid time off
Senior Benchmarking Engineer - Performance & Research
Senior Benchmarking Engineer - Performance & Research

Elastic • Mountain View (CA)

On-site
USD 133,000 - 211,000
Health coverage
Flexible locations & schedules
Vacation days
+3
Remote Research Scientist, AI Benchmark Evaluation
Remote Research Scientist, AI Benchmark Evaluation

Ladders • United States

Remote
USD 198,000 - 340,000
Cutting-edge research
Funding for AI research
Open-source contributions
+2
Senior Evaluation Architect for AI Benchmarks
Senior Evaluation Architect for AI Benchmarks

Surge AI • United States

Remote
USD 90,000 - 150,000