Member of Technical Staff — Frontier AI Benchmarking

Apply

Northern (KY)

Hybrid

USD 180,000 - 280,000

Full time

5 days ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Equity ownership
401(k) match
Parental leave
Wellbeing stipend
Learning stipend
SF office access
Flexible PTO
Team outings

Job summary

Handshake is hiring a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will work with world‑class AI researchers and engineers to develop benchmarks, verifier systems, and data-quality techniques for AI coding applications.

Early team members shape technical direction, open-source projects, and research products while operating with high ownership and a builder's mindset.

Qualifications

  • Experience building AI benchmarks and evaluating frontier models.
  • Publication or strong track record in AI for software/code generation is a plus.
  • Demonstrated software engineering ability and OSS contributions.

Responsibilities

  • Create/publish Coding benchmarks that challenge frontier agents.
  • Study and publish findings on the frontier of coding agents.
  • Support labs in improving models for coding.
  • Contribute to open-source benchmarks, tools, and research.

Skills

Coding benchmarks
Agent harnesses
Open-source contributions
Research publication

Tools

GitHub
Benchmarks tooling

Job description

Handshake is hiring a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will work with world‑class AI researchers and engineers to develop benchmarks, verifier systems, and data-quality techniques for AI coding applications.

Early team members shape technical direction, open-source projects, and research products while operating with high ownership and a builder's mindset.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Engineer, AI Benchmarking & Agent Evaluation
Staff Engineer, AI Benchmarking & Agent Evaluation

Handshake • Mountain View (CA)

On-site
USD 270,000 - 350,000
Equity
401(k) match
Parental leave
+7
Frontier AI Benchmark Engineer
Frontier AI Benchmark Engineer

Handshake • United States

On-site
USD 180,000 - 260,000
Equity
401(k) match
Parental leave
+1
Staff Engineer — Frontier AI Coding Benchmarks & Evaluations
Staff Engineer — Frontier AI Coding Benchmarks & Evaluations

Openkrill • United States

Remote
USD 180,000 - 260,000
Equity in a fast-growing company
401(k) match
Parental leave and fertility benefits
+9
Staff AI Research Engineer: Frontier Coding Benchmarks
Staff AI Research Engineer: Frontier Coding Benchmarks

Handshake • San Francisco (CA)

On-site
USD 200,000 - 280,000
Equity
401(k) match
Parental leave
+5
Staff Engineer, AI Benchmarking & Evaluation
Staff Engineer, AI Benchmarking & Evaluation

Handshake • New York (NY)

On-site
USD 270,000 - 350,000
Ownership: Equity in a fast-growing公司
Financial Wellness: 401(k) match, comp
Family Support: Paid parental leave,育儿
+5
Staff AI Evals Engineer for Frontier Benchmarks
Staff AI Evals Engineer for Frontier Benchmarks

Handshake • United States

On-site
USD 180,000 - 240,000
Equity
401(k) match
Parental leave
+11
Frontier AI Coding Benchmarks Engineer
Frontier AI Coding Benchmarks Engineer

Handshake • United States

Remote
USD 150,000 - 190,000
Staff AI Engineer, Coding Agents & Benchmarks
Staff AI Engineer, Coding Agents & Benchmarks

Neolife Updates • New York (NY)

On-site
USD 270,000 - 350,000
Member of Technical Staff (Fully Remote)
Member of Technical Staff (Fully Remote)

Handshake • United States

Remote
USD 150,000 - 190,000
Staff Scientist, Frontier AI Evaluations & Benchmarks
Staff Scientist, Frontier AI Evaluations & Benchmarks

Openkrill • United States

Remote
USD 180,000 - 320,000
Equity in a fast-growing company
401(k) match
Paid parental leave
+7