AI Assessment & Rubric Architect

Crossing Hurdles; South Africa; On-site; ZAR 334,800 - 502,200; Full time

Job summary

Crossing Hurdles is looking for a professional to design and refine comprehensive rubrics for AI training and assessment needs in South Africa. The successful candidate will analyze task performance and provide structured feedback to guide improvements. Responsibilities include leading calibration sessions and overseeing quality control processes.

Applicants should have proven expertise in rubric design, scoring methodology development, and exceptional communication skills, as well as hands-on experience that informs realistic assessments.

Qualifications

• Proven expertise in rubric design and performance analysis.
• Strong background in scoring methodology development.
• Exceptional written and verbal communication skills.

Responsibilities

• Design, develop, and refine comprehensive rubrics tailored to AI training.
• Analyze task performance and provide actionable feedback.
• Lead calibration sessions to align evaluators and maintain rubric integrity.

Skills

Expertise in rubric design

Performance analysis

Feedback structuring

Scoring methodology development

Communication skills

Job description

Crossing Hurdles is looking for a professional to design and refine comprehensive rubrics for AI training and assessment needs in South Africa. The successful candidate will analyze task performance and provide structured feedback to guide improvements. Responsibilities include leading calibration sessions and overseeing quality control processes.

Applicants should have proven expertise in rubric design, scoring methodology development, and exceptional communication skills, as well as hands-on experience that informs realistic assessments.