Head of AI Assessments & Certification Content

DataCamp; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

DataCamp is seeking an experienced professional to own the design and production of assessment and certification content, collaborating with SMEs to build AI-driven workflows that generate, review, and refresh high-quality items at scale.

You will design psychometrically sound assessments, define scoring standards, and ensure validity and fairness while aligning certifications with real-world Data and AI skills hiring managers look for.

Qualifications

• A technical background in a STEM field and experience evaluating technical competency through design of coding assessments, interviews, or exams.
• Demonstrated expertise in assessment design including item writing, scoring, standard-setting, and reliability.
• Ability to translate data and AI skills into certification measures.
• Experience with agentic AI systems and building AI automation workflows.
• Graduate degree in a related STEM discipline or equivalent hands-on expertise in data science, ML, or software development.

Responsibilities

• Own the end-to-end lifecycle for assessment and certification content, including blueprint, item design, review, publication, and maintenance.
• Design psychometrically sound assessments to ensure validity, reliability, and fairness.
• Build and operate AI workflows that draft, grade, and quality-check items at scale.
• Collaborate with subject-matter experts to keep certifications current with the AI/data landscape.
• Map certifications to real-world skills hiring managers screen for.
• Benchmark against the broader certification landscape and set future strategy.
• Monitor performance through pass rates and learner/employer feedback to drive improvements.

Skills

Assessment design

AI workflows

Content production

Cross-team collaboration

Communication

Education

Master’s or PhD in STEM

Tools

Claude Code

Cursor

Replit

Job description

DataCamp is seeking an experienced professional to own the design and production of assessment and certification content, collaborating with SMEs to build AI-driven workflows that generate, review, and refresh high-quality items at scale.

You will design psychometrically sound assessments, define scoring standards, and ensure validity and fairness while aligning certifications with real-world Data and AI skills hiring managers look for.