Psychometrician, Office of Assessment and Evaluation (PhD) (Phoenix)

University of Arizona; Phoenix (AZ); On-site; USD 120,000 - 170,000; Full time

Job summary

The University of Arizona College of Medicine – Phoenix invites applications for a Psychometrician, Office of Assessment and Evaluation, at an assistant/associate professor level. This full-time, career-track position entails leading psychometric activities for examinations and assessments, advancing measurement methods for medical knowledge and clinical skills.

The role includes item analysis, data analyses for accreditation standards, building data infrastructure, collaboration with exam

Qualifications

• PhD in educational or psychological measurements, statistics or related field.
• 1–3 years of relevant experience.
• Proficiency in SAS and R.
• Strong knowledge of psychometric principles including IRT and CTT.

Responsibilities

• Lead item analysis, IRT calibrations, scoring, equating, and validity studies across MD assessments.
• Perform comprehensive assessment data analyses to support quality assurance and LCME accreditation.
• Develop and maintain operational psychometric processes for efficiency and scalability.
• Collaborate with exam developers on item writing, review and evaluation.
• Design data architecture for assessment data and enable rapid querying/responses.
• Collaborate on research and disseminate findings via presentations and publications.
• Provide expert consultation on research design and statistical methodologies.
• Develop dashboards for real-time student assessment insights.
• Other duties as assigned.

Skills

Statistical analysis

IRT methods

Interpersonal communication

Research design

Education

PhD in educational/psychological measurements or statistics

Tools

SAS

R

Job description

Psychometrician, Office of Assessment and Evaluation (PhD) (Phoenix)

Psychometrician, Office of Assessment and Evaluation (PhD) (Phoenix)

Position Highlights

The Office of Assessment and Evaluation (OAE) at the University of Arizona College of Medicine – Phoenix is currently seeking a psychometrician to join our team. In this role, the psychometrician will lead psychometric activities related to examinations and assessments, while advancing methods, processes and best practices in the measurement of medical knowledge, clinical skills and overall MD program evaluation.

The successful candidate will fulfill the responsibilities of a faculty member in the Department of Biomedical Informatics, actively participate in teaching, clinical service and/or scholarly work and must qualify for an appointment at the rank of assistant or associate professor. The successful candidate will meet the requirements of a career track faculty according to the College and University guidelines.

This career-track appointment is not eligible for tenure.

The University of Arizona College of Medicine – Phoenix anchors the 28-acre Phoenix Biosciences Core (PCB) campus in the heart of the Valley of the Sun. The College inspires and trains individuals to become exemplary physicians, scientists and leaders who are life-long learners and inquisitive scholars. The PBC campus embodies the University’s priorities of engagement, partnership, innovation, and synergy in its world-class academic and research initiatives, with clinical facilities throughout Greater Phoenix.

Visa sponsorship is not available for this positions.

Outstanding U of A benefits include health, dental, and vision insurance plans; life insurance and disability programs; paid vacation, sick leave, and holidays; U of A/ASU/NAU tuition reduction for the employee and qualified family members; retirement plans; access to U of A recreation and cultural activities; and more!

The University of Arizona has been recognized for our innovative work-life programs. For more information about working at the University of Arizona and relocations services, please click here .

Duties & Responsibilities

Reporting to the assistant dean of Assessment and Evaluation, the psychometrician will have the following primary responsibilities:

• Perform item analysis, item response theory (IRT) calibrations, scoring, equating, standard setting and validity and reliability studies across multiple assessments. These include, but are not limited to, knowledge-based and clinical assessments in both the pre-clerkship and clerkship phases of the MD program.
• Conduct comprehensive assessment data analyses to support continuous quality improvement and ensure compliance with accreditation standards, including those of the Liaison Committee on Medical Education (LCME). Analyses include, but are not limited to, descriptive and inferential statistics; retrospective and prospective analyses; and cross-sectional and longitudinal analyses of assessment and program data.
• Develop, maintain and continuously improve operational psychometric processes to enhance efficiency, accuracy and scalability.
• Collaborate with subject matter experts and exam developers in item writing, item review and the design, development and evaluation of assessments.
• Design and build robust infrastructure for assessment data architecture, enabling efficient querying, rapid data retrieval and timely, accurate responses to data requests.
• Collaborate on research and development initiatives within OAE and across the institution and disseminate findings to the broader medical education community through presentations and peer-reviewed publications.
• Provide expert consultation on research design, measurement, statistical methodologies and data systems.
• Develop and maintain a comprehensive dashboarding system for student assessment data to support real-time insights and data-informed decision-making.
• Other duties as assigned.

Minimum Qualifications

• Hold a PhD in educational or psychological measurements, statistics or a related field from an accredited institution.
• Have a minimum of one to three years’ of relevant experience.

Preferred Qualifications

• Demonstrate proficiency in statistical analysis and IRT software, including (but not limited to) SAS and R.
• Have strong knowledge and applied experience in psychometric principles, including item response theory (e.g., item calibration, item evaluation, linking/equating, and IRT-based scoring), classical test theory and standard setting methodologies.
• Demonstrate outstanding interpersonal communication and professionalism skills.

Rank

Associate Professor

FLSA

Exempt

Full Time/Part Time

Full Time

Number of Hours Worked per Week

40

Job FTE

1.0

Work Calendar

Fiscal

Job Category

Faculty

Benefits Eligible

Yes - Full Benefits

Rate of Pay

AAMC Public Schools for Rank and Specialty

Compensation Type

salary at 1.0 full-time equivalency (FTE)

Type of criminal background check required:

Name-based criminal background check (non-security sensitive)

Number of Vacancies

1

Open Date

7/23/2026

Open Until Filled

Yes

Documents Needed to Apply

Curriculum Vitae (CV), Cover Letter, and One Additional Document

Contact Information for Candidates

Office of Human Resources, Talent Acquisition

[e-mail]

Notice of Availability of the Annual Security and Fire Safety Report

In compliance with the Jeanne Clery Campus Safety Act (Clery Act), each year the University of Arizona releases an Annual Security Report (ASR) for each of the University’s campuses.Thesereports disclose information including Clery crime statistics for the previous three calendar years and policies, procedures, and programs the University uses to keep students and employees safe, including how to report crimes or other emergencies and resources for crime victims. As a campus with residential housing facilities, the Main Campus ASR also includes a combined Annual Fire Safety report with information on fire statistics and policies, procedures, and programs the University uses to keep students and employees safe, including how to report crimes or other emergencies and resources for crime victims.
Paper copies of the Reports can be obtained by contacting the University Compliance Office at [e-mail].