Staff Engineer — AI Coding Benchmarks & Evaluations

Fdetimes; San Francisco (CA); Presencial; USD 180.000 - 260.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Equity in a fast-growing company

401(k) match

Medical, dental and vision coverage

Mental health support

$500 wellness stipend

Learning stipend and development

Descripción de la vacante

Handshake is hiring a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will partner with top AI researchers and thousands of software engineers to develop new benchmarks, reward and verifier systems, agent-evaluation methodologies, and data-quality techniques centered on AI for Coding.

Location: San Francisco preferred; exceptional candidates in other locations are welcome.

Formación

• Demonstrated ability to conduct independent research in AI safety, benchmarks, or coding agents.
• Experience publishing research or open-source benchmarks is a plus.
• Strong software engineering fundamentals and systems thinking.

Responsabilidades

• Create/publish Coding benchmarks that challenge state-of-art frontier agents.
• Understand/shape the frontier of coding agents and where the space is headed, publishing studies of interesting/impactful findings.
• Help the world’s top AI Labs improve their models for coding.
• Publicly contribute to the field through benchmarks, open-source tools, research, and technical writing.

Conocimientos

Research mindset

OSS contributions

Agent harnesses

Ambiguity tolerance

Descripción del empleo

Handshake is hiring a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will partner with top AI researchers and thousands of software engineers to develop new benchmarks, reward and verifier systems, agent-evaluation methodologies, and data-quality techniques centered on AI for Coding.

Location: San Francisco preferred; exceptional candidates in other locations are welcome.