Senior Scientist, AI-Driven Psychometrics & Assessments

SHL; Atlanta (GA); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Hybrid remote flexibility

Excellent benefits package

Professional development opportunities

Job summary

SHL, a leader in people science, seeks a Senior Scientist to design and prototype next-generation assessments combining psychometrics with AI-enabled experiences. You will lead measurement development, validate models, and ensure fairness and regulatory alignment.

The role requires a PhD/advanced degree and 5+ years designing/validating assessments, with proficiency in Python/R and AI tools. Hybrid/remote options available from the US, with Atlanta preferred.

Qualifications

• Master’s or PhD in Industrial-Organizational Psychology, Psychometrics, Quantitative Psychology, Data Science or a closely related field.
• 5+ years of post-graduate experience designing, developing, or validating assessments used in organizational decision-making.
• Demonstrated experience leading innovation in assessment design or applied research.
• Strong applied psychometrics, including CTT and/or IRT, reliability and validity evidence, factor analysis, and statistical modeling.
• Hands-on proficiency in Python and/or R, and fluency with current AI tools, including LLM APIs, prompt design, and modern prototyping workflows.
• Working knowledge of the legal and professional landscape governing selection, including the Uniform Guidelines, SIOP Principles, the Standards for Educational and Psychological Testing, and evolving AI in hiring requirements.
• Ability to communicate measurement concepts clearly to mixed technical and non-technical audiences.

Responsibilities

• Design novel assessments and measurement concepts, including simulations, situational judgment tests, adaptive and game-based formats, and conversational/LLM-driven task types.
• Build working prototypes and translate measurement concepts into functional proofs-of-concept using modern AI tooling.
• Own psychometric quality across reliability, validity, and scoring, combining theory with AI/ML scoring.
• Incorporate fairness and legal defensibility into assessments from design through development and audit.
• Translate measurement constructs and scoring models into engaging, credible assessment experiences.
• Conduct validation studies (criterion-related, content, construct) and share findings with diverse audiences.
• Collaborate with Product, Engineering, Legal, and client-facing teams to advance prototypes toward production-ready solutions.
• Monitor advances in AI/ML and psychometrics and apply relevant developments responsibly.

Skills

Python

R

AI/ML tooling

IRT/CTT

Statistical modeling

Communication

Leadership

Psychometrics

Education

PhD in Industrial-Organizational Psychology

MS/PhD in related field

Tools

Python

R

LLM/APIs

Prototyping tools

Job description

SHL, a leader in people science, seeks a Senior Scientist to design and prototype next-generation assessments combining psychometrics with AI-enabled experiences. You will lead measurement development, validate models, and ensure fairness and regulatory alignment.

The role requires a PhD/advanced degree and 5+ years designing/validating assessments, with proficiency in Python/R and AI tools. Hybrid/remote options available from the US, with Atlanta preferred.