A complete application in a minute
Tailored resume and cover letter, ready to send.
Surge AI is seeking a senior evaluator to lead benchmark design and validation for AI research projects in the United States. You will guide grading operations, calibrate graders, and resolve disputes while shaping scoring methods for standardized benchmarks.
Ideal candidates bring 5+ years in evaluation, and proven ability to design assessments and develop gold-standard answers. Proficiency in Python and evaluation tools is required to drive rigorous benchmarking programs.
Surge AI connects senior evaluation experts to support AI research and model testing. The company focuses on rigorous benchmark design and grading for AI systems, with a network of specialized contractors working on diverse projects.