Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Ladders is seeking a Research Scientist for Open Benchmarks Red Team to strengthen AI evaluation by identifying weaknesses in frontier benchmarks and guiding robust releases. The role blends research and engineering, focusing on LLMs, AI agents, and experimental analysis of model behavior.
Work with researchers and engineers to reproduce benchmark issues, develop fixes with authors, and contribute to reports, tools, and publications that influence the AI evaluation ecosystem.
For our client, we are seeking a Research Scientist, Open Benchmarks Red Team to join the team of a leader in the Information Technology space.
This role focuses on strengthening the reliability and rigor of AI evaluation by finding weaknesses in frontier benchmarks and helping improve how they are assessed. You will work at the intersection of research and engineering, developing practical methods to identify issues, validate findings, and support better benchmark releases. The position calls for close collaboration with researchers and engineers while contributing to technical reports, tools, and publications that influence the broader AI evaluation ecosystem.
The work is highly technical and research-driven, with a strong emphasis on LLMs, AI agents, and experimental analysis of model behavior.
Location: Remote
Compensation: $198,000 – $340,000 annually
Our client is an equal opportunity employer.