Staff Engineer — Frontier AI Coding Benchmarks & Evaluations

Openkrill; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Equity in a fast-growing company

401(k) match

Parental leave and fertility benefits

Medical, dental, vision

Wellbeing stipend

Learning stipend

Commuting support

Free lunch

Gym in SF office

Flexible PTO

Holidays + 2 flex days

Team outings & referrals

Job summary

Handshake is hiring a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will work with world-class researchers and engineers to develop new benchmarks, verifier systems, and data-quality techniques for coding AI.

Location: San Francisco preferred; exceptional candidates in other locations considered. You will influence technical direction, open-source software, benchmarks, and research products we build.

Qualifications

• Experience publishing research on AI for code generation.
• Strong track record with coding benchmarks or related studies.
• Extensive OSS contributions or experience with agent harnesses.

Responsibilities

• Create/publish Coding benchmarks for frontier agents.
• Shape the direction of coding agent evaluation research.
• Collaborate with AI labs to improve models for coding.
• Contribute to open-source benchmarks, tools and papers.

Skills

Coding benchmarks

Research publications

OSS contributions

Agent harnesses

GitHub activity

Tools

GitHub

Job description

Handshake is hiring a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will work with world-class researchers and engineers to develop new benchmarks, verifier systems, and data-quality techniques for coding AI.

Location: San Francisco preferred; exceptional candidates in other locations considered. You will influence technical direction, open-source software, benchmarks, and research products we build.