Research Engineer, Benchmarking

Refresh; San Francisco (CA); On-site; USD 120,000 - 190,000; Full time

Job summary

Refresh is seeking a Research Engineer focused on benchmarking, to build rigorous evaluations of real-world coding and computer-use capabilities. You will translate expert workflows into verifiable tests and run benchmarks against frontier models.

In this role you’ll work across our core stack (Vercel, Supabase, Render) and engage with reinforcement learning and supervised fine-tuning at a high level to publish robust numbers.

Job description

# Research Engineer, BenchmarkingEngineeringSan FranciscoFull-timeBuild the benchmarks frontier labs use to measure real-world coding and computer-use capability. Translate expert workflows into rigorous, verifiable evaluations, run them against frontier models, and publish numbers that hold up under adversarial scrutiny.Across every role at Refresh: you're willing to ship full-stack work on our core stack (Vercel, Supabase, Render) when it's needed, and you're comfortable with reinforcement learning and supervised fine-tuning at a high level.