Benchmarking Research Engineer: Frontier Model Evaluations

Refresh AI; San Francisco (CA); Vor Ort; USD 120.000 - 150.000; Vollzeit

Zusammenfassung

Refresh AI is seeking a Research Engineer in San Francisco to push the boundaries of benchmarking technology. You will build benchmarks that labs use for evaluating coding abilities and computer-use capability. Your role will require expertise in reinforcement learning and supervised fine-tuning, as well as a willingness to engage in full-stack development on our core tech stack (Vercel, Supabase, Render). This position offers a full-time role in a dynamic environment.

Qualifikationen

• Experience with reinforcement learning and supervised fine-tuning.
• Ability to ship full-stack work on core technologies when required.

Aufgaben

• Build benchmarks for coding and computer-use capability.
• Translate expert workflows into rigorous evaluations.
• Run evaluations against frontier models and publish verifiable numbers.

Kenntnisse

Reinforcement learning

Supervised fine-tuning

Full-stack development

Tools

Vercel

Supabase

Render

Jobbeschreibung

Refresh AI is seeking a Research Engineer in San Francisco to push the boundaries of benchmarking technology. You will build benchmarks that labs use for evaluating coding abilities and computer-use capability. Your role will require expertise in reinforcement learning and supervised fine-tuning, as well as a willingness to engage in full-stack development on our core tech stack (Vercel, Supabase, Render). This position offers a full-time role in a dynamic environment.