AI Evaluation Scientist

Job Title: AI Evaluation Scientist

• Salary: £34,500 - £44,850
• Location: Cambridge, Hybrid
• Contract: Permanent, Full Time, 35 hours per week

Are you passionate about AI and data science, as well as ensuring fairness, transparency, and accuracy in AI-enhanced assessment? If so, we want to hear from you!

We are Cambridge University Press & Assessment, a world-leading academic publisher and assessment organisation and a proud part of the University of Cambridge. Our Applied AI team is looking for a talented AI evaluation specialist to join our expanding team of validation specialists and machine learning engineers.

As an AI Evaluation Scientist, you will play a critical role in evaluating and improving our AI-enhanced capabilities. Your expertise in statistical analysis and AI evaluation will ensure that our next-generation assessment solutions meet the highest validity, fairness, and regulatory standards. This role is central to maintaining Cambridge's reputation as a global leader in AI-enhanced education and assessment.

About The Role

As part of our Applied AI team, you will be responsible for helping drive the evaluation of our AI-enhanced assessment technologies to ensure their accuracy, fairness, and explainability. You will work closely with validation specialists and machine learning engineers to implement robust statistical analyses and help develop innovative evaluation methods to help shape the future of AI-powered second language learning.

Key responsibilities include:

• Conducting statistical evaluations to assess the fairness, accuracy, and transparency of our AI-enhanced assessment technologies, ensuring they align with Cambridge's educational assessment principles.
• Contributing to the development and design of validation frameworks and quality assurance processes to ensure AI models meet regulatory requirements and industry best practices.
• Identifying and applying cutting-edge AI evaluation methods, helping advance both our AI capabilities and the science of AI evaluation.
• Collaborating with validation specialists and machine learning engineers to develop next-generation AI-driven educational technologies.
• Publishing findings in academic and industry contexts, presenting insights to both technical and non-technical stakeholders, and representing Cambridge as an AI evaluation expert.

We are a hybrid working organisation, offering flexible working options from day one. We expect most hybrid colleagues to spend 40-60% of their time at their dedicated office. We also consider other flexible arrangements to accommodate individual needs or disabilities.

Ready to pursue your potential? Apply now.

We review applications on an ongoing basis, with a closing date of Sunday 18^th May 2025. You can expect to hear about your application within two weeks of submission.

We reserve the right to close this vacancy early once sufficient applications are received. Early applications are encouraged.

All applications must be submitted via our official online form. Please do not send CVs directly to recruiters.

Successful applicants will undergo background checks, including DBS, due to industry regulations.

Cambridge University Press & Assessment is an approved UK sponsor for Skilled Worker visas. Visit gov.uk for eligibility details.

Why join us

Join us to pursue your potential in a collaborative environment committed to innovation and diversity. We support a culture of continuous learning and welcome applicants from all backgrounds, including age, disability, ethnicity, gender, and more.

Rewards and benefits

We offer a competitive salary and a flexible rewards package, including:

• 28 days annual leave plus bank holidays
• Private medical and health insurance
• Discretionary bonus
• Group pension scheme
• Life assurance (up to 4x salary)
• Green travel schemes

Desirable Experience

• Experience evaluating AI-enhanced assessment and learning technologies
• Collaboration with ML engineers on AI model evaluation
• Knowledge of assessment principles and evaluation methods
• Experience embedding standardized AI evaluation processes in industry

This role is based in Cambridge with occasional on-site work.

About You

We seek an analytical professional with expertise in inferential statistics and AI evaluation methods, capable of working within a diverse team. You should have:

• A degree in a quantitative field or equivalent experience, focusing on AI model evaluation
• Strong knowledge of inferential statistics and multivariate analysis
• Practical experience evaluating AI models, including explainable AI methods
• Proficiency in Python or R (Python preferred)
• Willingness to learn new statistical approaches
• Ability to manage projects and deliver results on time
• Skill in translating technical insights for decision-makers
• A commitment to ethical AI and educational fairness