Frontier AI Benchmark Engineer

Handshake; United States; On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Equity

401(k) match

Parental leave

Wellbeing stipend

Job summary

Handshake is hiring a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will work with world‑class AI researchers and thousands of software engineers to develop benchmarks, reward and verifier systems, and data-quality techniques for coding applications.

Early team members will influence technical direction and open-source software we build. Location: San Francisco preferred; exceptional candidates elsewhere considered.

Qualifications

• Experience building and evaluating coding benchmarks.
• Strong track record of OSS contributions or GitHub activity.
• Deep knowledge of agent harnesses and AI for software/code-generation is a plus.

Responsibilities

• Create/publish Coding benchmarks that challenge state-of-the-art frontier agents.
• Understand/shape the frontier of coding agents and publish findings.
• Help top AI labs improve their models for coding.
• Publicly contribute to the field through benchmarks, open-source tools, research, and technical writing.

Skills

Coding benchmarks experience

Open-source contributions

Agent harnesses knowledge

Job description

Handshake is hiring a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will work with world‑class AI researchers and thousands of software engineers to develop benchmarks, reward and verifier systems, and data-quality techniques for coding applications.

Early team members will influence technical direction and open-source software we build. Location: San Francisco preferred; exceptional candidates elsewhere considered.