Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Surge AI is seeking a senior evaluator to lead benchmark design and validation for AI research projects in the United States. You will guide grading operations, calibrate graders, and resolve disputes while shaping scoring methods for standardized benchmarks.
Ideal candidates bring 5+ years in evaluation, and proven ability to design assessments and develop gold-standard answers. Proficiency in Python and evaluation tools is required to drive rigorous benchmarking programs.
Surge AI is seeking a senior evaluator to lead benchmark design and validation for AI research projects in the United States. You will guide grading operations, calibrate graders, and resolve disputes while shaping scoring methods for standardized benchmarks.
Ideal candidates bring 5+ years in evaluation, and proven ability to design assessments and develop gold-standard answers. Proficiency in Python and evaluation tools is required to drive rigorous benchmarking programs.