Senior Psychometrician

MetaMetrics, Inc; Lowes Grove (NC); Remote; USD 95,000 - 150,000; Full time

Job summary

MetaMetrics, Inc. invites applications for a Senior Psychometrician to help uphold validity, reliability, and fairness of our assessment products.

This fully remote role collaborates with research, product, engineering, and customer success to advance education measurement. You will plan and execute psychometric projects, supervise analyses such as linking/equating, and translate findings into client-facing deliverables and white papers.

Qualifications

• Doctoral degree in educational statistics, measurement, psychometrics, or related field.
• 5+ years of experience as a practicing psychometrician.
• Experience with educational assessment and standard psychometric procedures (item analysis, calibration, equating).
• Familiarity with education technology infrastructure and development, including relational databases, software development languages (e.g., C++), REST APIs, and Agile project management.

Responsibilities

• Develops plans and executes psychometric projects and research according to priorities and resource availability.
• Directs creation and maintenance of project schedules and client communications; evaluates external data and reviews results.
• Conducts linking/equating studies and develops white papers and summaries for stakeholders.
• Implements and improves psychometric methods and processes per best practices and standards.

Skills

Psychometrics

Statistical analysis

Education assessment

Rasch calibration

Education

PhD in educational statistics or psychometrics

Tools

R

Python

WINSTEPS

FACETS

C++

REST APIs

G Suite / MS Office

Job description

Fully Remote Durham Research and Development

Job Type

Full-time

Description

At MetaMetrics, we believe every learner deserves the opportunity to succeed. Our mission is to empower educators, students, and families with trusted assessment solutions that provide meaningful insights and support learning. We're looking for a passionate and experienced Senior Psychometrician to help advance that mission.

As a Senior Psychometrician, you will play a pivotal role in ensuring the validity, reliability, and fairness of our assessment products. Working alongside talented colleagues across research, product, engineering, and customer success, you'll apply rigorous psychometric principles to develop innovative assessment solutions that improve educational outcomes for millions of learners.

This role offers the opportunity to influence the future of educational measurement while collaborating with a mission-driven team dedicated to making a lasting impact. The key responsibilities and qualifications for this position are outlined below.

• Develops plans and executes psychometric projects and research according to priorities and resource availability.
• Directs the creation and maintenance of project schedules, communication with clients, evaluation of external data, and review of process and results produced by Research Analysts.
• Conducts independent linking/equating and research studies, supports the completion of studies by others, and develops white papers and research summaries.
• Implements and improves psychometric research methods and processes at MetaMetrics according to best practices, industry standards, and academic literature.
• Maintains awareness of psychometric literature and methods regarding test and delivery methods (e.g., fixed-form, computer adaptive, and linear-on-the-fly), statistical methods (e.g., simulation studies), and computational psychometrics (e.g., machine learning, Bayesian inference).
• Provides ad hoc or planned expert consultation to clients and their stakeholders (e.g., technical advisory committees) regarding methods, results, and interpretation of MetaMetrics products and services.
• Perform other duties as assigned.

Supervisory Responsibilities

None. Provides support only in accordance with the organization’s policies and applicable laws.

Requirements

Education and/or Experience:

• A doctoral degree (Ph.D.) or equivalent in educational statistics, measurement, psychometrics, or related field is required, along with 5+ years of experience as a practicing psychometrician.
• Extensive experience with educational assessment and standard psychometric procedures (e.g., item analysis and calibration, score equating, scale linking).
• Familiarity with education technology infrastructure and development, including relational databases, software development languages (e.g., C++), and technologies (REST APIs), and program management (e.g., Agile).

Computer Skills:

Extensive experience with standard office and productivity software (e.g., Google Suite, Microsoft Office).

Proficiency with general statistical software (e.g., R; Python) and specialized psychometric software (e.g., WINSTEPS, FACETS).

Other Qualities:

Language Skills:

Ability to read, analyze, and interpret common scientific and technical journals and reports. Ability to respond to common inquiries from researchers, customers, or members of the general public. Ability to write presentations and articles for publication that conform to prescribed style and format. Ability to effectively present information to colleagues, management, and/or public groups.

Psychometric Skills:

Ability to apply advanced mathematical concepts such as exponents, logarithms, quadratic equations, and permutations. Ability to design and implement analyses related to test reliability and validity, analysis of variance, correlation techniques, sampling theory, and latent variable modeling. Ability to apply and interpret statistical procedures, including but not limited to Rasch calibration, linking, and equating.

Presentation Skills:

Ability to clearly and succinctly present analyses results to internal stakeholders (e.g., Sales, Test Development), external partners, and respond to psychometric and measurement questions related to MetaMetrics' core business.

Reasoning Ability:

Ability to apply principles of logical or scientific thinking to a wide range of intellectual and practical problems. Ability to deal with a variety of abstract and concrete variables.

Publishing:

- A track record of peer-reviewed research publications and conference papers is preferred.