Rubrics Expert

Micro1; India; Remote; INR 600,000 - 900,000; Part time

Job summary

Cashback24x7 is seeking a Rubrics Expert for a remote contract role. You will design and validate rubrics for AI training projects, developing scoring methodologies and leading calibration to ensure consistent, high-quality outputs.

The role combines rubric development with practical grocery-shopping insights to enhance realism in AI assessments. You will analyze performance, provide actionable feedback, and collaborate with cross-functional teams to align prompt design principles with project

Qualifications

• Experience in rubric design for complex assessments.
• Strong background in scoring methodology development and calibration.
• Proven ability to validate assessment outputs and ensure quality.

Responsibilities

• Design, develop, and refine rubrics for AI training and assessment.
• Analyze task performance and provide structured, actionable feedback.
• Establish and document effective scoring methodologies for consistency and fairness.
• Lead calibration sessions to align evaluators and maintain rubric integrity.
• Validate assessment outputs for accuracy and alignment with project objectives.
• Oversee quality control and recommend rubric improvements based on data.
• Collaborate with cross-functional teams to include prompt design and grocery shopping scenarios.

Skills

Rubric design

Performance analysis

Feedback structuring

Scoring methodologies

Calibration sessions

Prompt design for AI

Real-world judgment

Grocery shopping insights

Communication skills

Quality control

Job description

Job Title: Rubrics ExpertJob Type: ContractLocation: RemoteJob Summary: Join our customer's team as a Rubrics Expert, where you will play a pivotal role in designing and validating robust rubrics for AI training projects. Utilize your expertise in performance analysis, scoring methodology, and real-world judgment to ensure the highest quality of assessment outputs. This unique opportunity allows you to combine your experience in rubric development with practical grocery shopping insights to elevate the accuracy and realism of AI models.

Key Responsibilities:

• Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs.
• Analyze task performance and provide structured, actionable feedback to guide improvement and calibration.
• Establish and document effective scoring methodologies that ensure consistency, fairness, and high-quality outcomes.
• Lead calibration sessions to align evaluators and maintain rubric integrity across projects.
• Validate assessment outputs for accuracy, reliability, and alignment with project objectives.
• Oversee quality control processes, making data-driven recommendations for rubric enhancements.
• Collaborate with cross-functional teams to integrate prompt design principles and grocery shopping scenarios into assessment frameworks.

Required Skills and Qualifications:

• Proven expertise in rubric design, performance analysis, and feedback structuring for complex assessment environments.
• Strong background in scoring methodology development and calibration for AI or educational projects.
• Demonstrated success in assessment validation and quality control processes.
• Exceptional written and verbal communication skills, with the ability to convey nuanced judgment and rationale.
• Experience with prompt design and rubric creation for AI-driven initiatives.
• Practical, hands-on grocery shopping experience (via apps, delivery, in-store, or pickup) to inform realistic scenario assessments.
• Detail-oriented, analytical, and adaptable approach to evolving project requirements.

Preferred Qualifications:

• Previous experience in AI data training or human data evaluation projects.
• Background in instructional design, educational assessment, or related field.
• Familiarity with agile work environments and cross-functional project collaboration.