Psychometrician

Vretta; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

Vretta is seeking a full-time Psychometrician to join the Data & Evaluation team. The role emphasizes reproducibility, validation, and automation of psychometric workflows using R.

You will analyze model parameters, advise on best practices, and build scalable data models to support student assessments. Collaboration with engineers and stakeholders is essential to deliver reliable tools and insights.

Qualifications

• Experience applying R in psychometrics contexts.
• Post-graduate degree in measurement/evaluation, research methodology, data science or equivalent.
• Proven ability to work seamlessly in a team.
• Ability to explain technical concepts to technical staff.
• Strong time management with minimal supervision.
• High level of critical thinking and analysis.

Responsibilities

• Reproduce and validate psychometric audit results using innovative and standard tools.
• Develop and maintain R scripts to automate validation and QA for psychometric instruments.
• Analyze model parameters and data characteristics affecting precision and validity.
• Replicate and review psychometric findings for methodological accuracy.
• Advise practitioners on best practices and procedures.
• Assess data models and assets to support psychometric applications.
• Build and enhance data models for psychometric analysis and reporting.
• Perform targeted data analyses to support decisions.
• Collaborate with stakeholders to manage timelines and resolve issues.
• Track progress, communicate updates and risks.
• Brief fellow psychometricians to promote knowledge sharing.
• Provide daily progress updates for alignment and accountability.
• Stay current with research and methodologies in psychometrics.

Skills

R language

Team collaboration

Technical communication

Time management

Critical thinking

Education

Post-Graduate Degree in Measurement, Evaluation, Research Methodology, Data Science or equivalent

Tools

PARSCALE

R Packages for IRT

Python (catsim)

Machine learning techniques

Cognitive Diagnosis Modelling

Job description

Vretta is looking for a full-time Psychometrician to join our Data & Evaluation team. This position requires excellent communication skills, creative problem solving ability, and a sound technical ability to be able to understand requirements, develop reusable solutions, and provide guidance to our engineering teams. As a member of the Data & Evaluation team at Vretta, the Psychometrician must have the attitude and energy to innovate and build solutions that support student success.

Responsibilities

• Reproduce and validate psychometric audit results using both innovative and standard tools to ensure accuracy and reliability.
• Develop and maintain R scripts to automate validation and quality assurance for psychometric instruments built in various languages and software.
• Analyze model parameters and data characteristics impacting the precision, validity, and alignment of psychometric algorithms.
• Replicate and review psychometric findings to confirm methodological accuracy.
• Advise practitioners on best practices, methodologies, and recommended procedures.
• Assess engineered options, recommend data models, and define assets to support psychometric applications.
• Build and enhance data models for psychometric analysis and reporting.
• Perform targeted data analyses to support decisions and project goals.
• Collaborate with stakeholders and internal users to manage timelines, resolve technical issues, and ensure smooth infrastructure integration.
• Track project progress, ensuring adherence to schedules, and proactively communicate updates and risks.
• Brief fellow psychometricians on information requests to promote knowledge sharing and transparency.
• Provide daily progress updates for alignment and accountability.
• Stay current with research, methodologies, and technological advances in psychometrics to continuously improve tools and practices.

Requirements

• Experience in applying the R language in a psychometric context.
• Post-Graduate Degree in Measurement, Evaluation, Research Methodology, Data Science or equivalent.
• Proven ability to work seamlessly in a team.
• Ability to effectively communicate technical concepts to other technical staff members.
• Superior time management skills, and the ability to prioritize tasks with minimal supervision.
• High level of critical and logical thinking, analysis, and/or reasoning to identify underlying principles, reasons, or facts.

Experience With Any Of The Following Is An Asset

• PARSCALE
• R Packages for Item Response Theory Analysis
• Python (including the catsim library)
• Machine Learning statistical techniques
• Cognitive Diagnosis Modelling
• Academic Writing

About Vretta

We are a multi-award winning EdTech company that is transforming the way students learn and use math every day. We collaborate with schools, colleges, and ministries around the world to re-imagine what really matters for students in the 21st century and to make sure that every student acquires meaningful quantitative skills that will serve them in their lives and professions. The user experience is at the heart of our creative process. This experience determines what sticks and what fades, and we see this as a tremendous opportunity to do better than anyone that has come before us. Every project is assigned a highly focused team of researchers, educators, designers, and software developers that are passionate about making an impact.