Head of Assessment and Certification Content

DataCamp; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

DataCamp is seeking an experienced professional to own the design and production of assessment and certification content, collaborating with SMEs to build AI-driven workflows that generate, review, and refresh high-quality items at scale.

You will design psychometrically sound assessments, define scoring standards, and ensure validity and fairness while aligning certifications with real-world Data and AI skills hiring managers look for.

Qualifications

• A technical background in a STEM field and experience evaluating technical competency through design of coding assessments, interviews, or exams.
• Demonstrated expertise in assessment design including item writing, scoring, standard-setting, and reliability.
• Ability to translate data and AI skills into certification measures.
• Experience with agentic AI systems and building AI automation workflows.
• Graduate degree in a related STEM discipline or equivalent hands-on expertise in data science, ML, or software development.

Responsibilities

• Own the end-to-end lifecycle for assessment and certification content, including blueprint, item design, review, publication, and maintenance.
• Design psychometrically sound assessments to ensure validity, reliability, and fairness.
• Build and operate AI workflows that draft, grade, and quality-check items at scale.
• Collaborate with subject-matter experts to keep certifications current with the AI/data landscape.
• Map certifications to real-world skills hiring managers screen for.
• Benchmark against the broader certification landscape and set future strategy.
• Monitor performance through pass rates and learner/employer feedback to drive improvements.

Skills

Assessment design

AI workflows

Content production

Cross-team collaboration

Communication

Education

Master’s or PhD in STEM

Tools

Claude Code

Cursor

Replit

Job description

About DataCamp

Data and AI skills are critical for thriving today, and DataCamp is the platform that empowers everyone to learn them. We help individuals and Fortune 1000 companies close the data and AI skills gap through world-class learning, hands-on training, and a global community of expert instructors.

In this role

In this role, you'll collaborate with instructors and teams across curriculum, engineering, product, and marketing to build and scale the assessments and certifications that prove those skills—helping millions worldwide validate what they've learned and signal it to employers.

About the role

This is an individual contributor role. You will own the design and production of DataCamp's assessment and certification content, working with subject-matter experts and building AI systems that generate, review, and continuously refresh high-quality, defensible questions at scale. Here’s what your day-to-day will look like:

• Own the end-to-end lifecycle for assessment and certification content—from blueprint and item design through review, publication, and ongoing maintenance—and manage deadlines across it.
• Design psychometrically sound assessments: write and review items, define scoring and passing standards, and safeguard validity, reliability, and fairness.
• Build and operate AI workflows—prompting, pipelines, and evaluation—that draft, grade, and quality-check items, so content production scales without sacrificing rigor.
• Source and collaborate with subject-matter experts to keep certifications current with the fast-moving data and AI landscape.
• Map certifications to the real skills hiring managers screen for, so a DataCamp credential is a credible signal to employers.
• Benchmark against the wider certification landscape—competing programs, industry standards, and emerging role definitions—and set the strategy for where our certifications go next.
• Continuously assess certification performance using pass rates, item statistics, and learner and employer feedback to drive improvements.

Qualifications

• A technical background in a STEM field—such as Computer Science, Data Science, AI, Statistics, or Engineering—paired with experience evaluating technical competency (e.g., designing coding assessments, technical interviews, certification exams, or graded coursework), so you can judge whether an assessment item is accurate and genuinely tests skill.
• Demonstrated expertise in assessment design—item writing, scoring, standard-setting, and the validity, reliability, and fairness principles behind credible certification—with proven experience building or running technical assessments or certification programs.
• A clear grasp of the skills hiring managers actually screen for in data and AI roles, and how to translate them into what a certification measures.
• Strong experience with agentic AI systems such as Claude Code, Cursor, or Replit, and building AI automation systems. You can demonstrate you've increased your output 10x with AI.
• Graduate degree (Master's or PhD) in a related STEM discipline, or equivalent industry experience with hands‑on expertise in data science, machine learning, or software development.

Bonus if you have the following

• A deep understanding of the DataCamp courses, assessments, and certifications.
• An extensive track record of building sophisticated AI systems and workflows.
• An understanding or interest in the current certification landscape in data and AI: how leading programs are structured, where they fall short, and what makes a credential respected by employers.