Data Scientist - Validation & Fairness for Scoring Engine

Deviare; South Africa; On-site; ZAR 700,000 - 900,000; Full time

Job summary

Deviare is seeking an experienced Data Scientist or Psychometrician to validate the platform's proprietary assessment algorithms behind a skills-science platform. You will ensure question banks are statistically reliable before production, requiring a strong statistical background, hands-on NLP validation, and a rigorous QA mindset focused on data accuracy and fairness.

In this gatekeeper role, you stress‑test models, verify data flows from test submissions to rate cards and talent matches, and

Qualifications

• Background in data science, data analysis or psychometrics.
• Experience evaluating assessments, surveys or standardised tests.
• Familiarity with Item Response Theory and Cronbach’s alpha.
• Ability to validate NLP models and text-extraction logic.

Responsibilities

• Stress-test core mathematical and logical models to ensure accuracy.
• Validate NLP/text-processing for bias and hallucinations.
• Verify data flow from test submission to rate-card and talent matching.
• Collaborate with C#/.NET backend engineers to report anomalies.

Skills

Data science

Data analysis

Psychometrics

Statistical testing

NLP validation

QA mindset

Tools

Python

R

SQL

Job description

Deviare is seeking an experienced Data Scientist or Psychometrician to validate the platform's proprietary assessment algorithms behind a skills-science platform. You will ensure question banks are statistically reliable before production, requiring a strong statistical background, hands-on NLP validation, and a rigorous QA mindset focused on data accuracy and fairness.

In this gatekeeper role, you stress‑test models, verify data flows from test submissions to rate cards and talent matches, and