Staff AI Research Engineer: Frontier Coding Benchmarks

Handshake; San Francisco (CA); On-site; USD 200,000 - 280,000; Full time

Benefits offered by this job

Equity

401(k) match

Parental leave

Mental health support

Learning stipend

Commuting support

Free lunch and gym in SF office

Flexible PTO and holidays

Job summary

Handshake is hiring a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will partner with top researchers and engineers to develop benchmarks, verifier systems, evaluation methodologies, and data-quality techniques for coding AI.

Early team members influence technical direction, culture, and open-source projects. Location: San Francisco preferred; exceptional candidates in other locations considered.

Qualifications

• Experience creating or evaluating coding benchmarks.
• Demonstrated ability to work across research and engineering teams.

Responsibilities

• Create/publish Coding benchmarks that challenge state-of-the-art frontier agents.
• Understand/shape the frontier of coding agents and publish impactful findings.
• Help AI labs improve their models for coding.
• Publicly contribute to the field through benchmarks, open-source tools, research, and technical writing.

Skills

Coding benchmarks

Ownership

Ambiguity tolerance

OSS contributions

Job description

Handshake is hiring a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will partner with top researchers and engineers to develop benchmarks, verifier systems, evaluation methodologies, and data-quality techniques for coding AI.

Early team members influence technical direction, culture, and open-source projects. Location: San Francisco preferred; exceptional candidates in other locations considered.