Psychometrician I

National Commission On Certification Of Physicians

Johns Creek (GA)

Remote

USD 82,000 - 98,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

National Commission on Certification of Physician Assistants (NCCPA) is seeking a Psychometrician I to provide psychometric expertise for our examination programs from Johns Creek, GA, with remote work and travel as needed. You will collaborate with senior staff to conduct psychometric analyses and contribute to research that strengthens our assessments.

As part of the team, you will lead item analysis, calibrations, scaling, equating, and validation activities, report findings, and help plan

Qualifications

  • PhD in Psychometrics, Quantitative Psychology or Educational Psychology required.
  • Knowledge of psychometric models including Classical Test Theory, Item Response Theory and equating.
  • Experience with item and test analysis software.
  • Ability to analyze, interpret, communicate and apply results of psychometric analyses and studies.
  • Ability to organize and plan work while managing multiple projects.

Responsibilities

  • Lead routine psychometric analyses across NCCPA examination programs, including IRT calibrations, scaling and equating, item analysis and key validation, standard setting, item bank analyses, and test form construction.
  • Plan and complete psychometric studies and quality assurance activities that support and improve NCCPA’s examination programs.
  • Develop and maintain documentation of key psychometric processes and contribute to planning of psychometric activities.
  • Monitor trends and research in certification, licensure testing, and assessment; provide recommendations for innovative assessment methods.
  • Collaborate across departments and communicate psychometric principles and findings to technical and non-technical audiences.
  • Facilitate exam-related activities and represent NCCPA on psychometric, assessment, and research matters with internal and external stakeholders.

Skills

IRT calibrations
Item analysis
Equating models
RShiny
Data visualization

Education

PhD in Psychometrics, Quantitative Psychology or Educational Psychology

Tools

Statistical software
IRT software

Job description

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Psychometrician I

Psychometrics & Data Science Full Time Johns Creek, GA, US

2 days ago Requisition ID: 1057

Salary Range: $82,000.00 To $98,000.00 Annually

Applicants must be authorized to work lawfully in the United States for NCCPA as NCCPA will not sponsor or take over sponsorship of employment visas.

As the Psychometrician I, you will provide psychometric expertise supporting NCCPA’s examination programs and contribute to research that helps strengthen and advance our assessment practices. Working alongside senior psychometric staff and department leadership, you will conduct psychometric analyses, support key examination activities, contribute to psychometric studies, and collaborate across the organization to ensure the quality and integrity of NCCPA’s examination programs.

In accordance with NCCPA’s Conflict of Interest Policy, any NCCPA employee who is a PA, lives with or is in a committed relationship with, or is related to a PA is prohibited from working on exam content, participating in NCCPA exam-related meetings and will not have access to NCCPA systems that contain PA data.

Reports To: Director of Psychometrics & Data Science

Who We Are

National Commission on Certification of Physician Assistants (NCCPA) is the only certifying organization for physician assistants in the United States. Established as a not-for-profit organization in 1974, we are dedicated to assuring the public that board certified PAs meet established standards of clinical knowledge and cognitive skills upon entry into practice and throughout their careers. All U.S. states, the District of Columbia and the U.S. territories have decided to rely on NCCPA certification as one of the criteria for licensure or regulation of PAs.

Location: NCCPA has determined that the telecommuting status of this position is remote, which means that employees in remote positions are allowed to primarily work remotely with required travel for mandatory meetings, including to the NCCPA headquarters in Johns Creek, Georgia.

As a matter of policy, NCCPA restricts remote positions to employees whose home office location is within a U.S. jurisdiction in the Eastern or Central time zones.

Why Work at NCCPA

We get to do meaningful work every day, and we enjoy working and having fun together! We’re proud to be recognized by the Atlanta Journal-Constitution as a Top Workplace in the metro Atlanta region.

How Will You Make a Difference? You will…

Lead routine psychometric analyses across NCCPA examination programs, including IRT calibrations, scaling and equating, item analysis and key validation, standard setting, item bank analyses, and test form construction.

Plan and complete psychometric studies and quality assurance activities that support and improve NCCPA’s examination programs.

Develop and maintain documentation of key psychometric processes and contribute to the planning of psychometric activities.

Monitor trends and research in certification, licensure testing, and assessment and provide recommendations for innovative assessment methods.

Collaborate across departments and communicate psychometric principles and research findings to both technical and non-technical audiences.

Facilitate exam-related activities and represent NCCPA on psychometric, assessment, and research matters with internal and external stakeholders.

Hard Skills You Will Have
  • PhD in Psychometrics, Quantitative Psychology or Educational Psychology, Measurement and Evaluation.
  • Knowledge of psychometric models, including Classical Test Theory, Item Response Theory, and equating models.
  • Knowledge of psychometric tools, including their capabilities and limitations.
  • Demonstrated ability to run and evaluate item and test analysis software.
  • Demonstrated ability to analyze, interpret, communicate, and apply results of psychometric analyses and studies.
  • Ability to organize and plan work effectively while managing multiple projects.
Soft Skills You Will Bring
  • Strong analytical, critical-thinking, and problem-solving skills.
  • Strong written and verbal communication skills with the ability to communicate technical information to a variety of audiences.
  • Strong organization, time management, and attention to detail.
  • Ability to work collaboratively as part of a team while effectively managing individual responsibilities.
  • Knowledge of developing user interfaces for interactive applications in RShiny.
  • Knowledge of data science methodologies, including data visualization, machine learning, and natural language processing.

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace.

NCCPA is committed to the full inclusion of all qualified individuals. In keeping with our commitment, NCCPA will take steps to assure that individuals with disabilities are provided reasonable accommodations. If a reasonable accommodation is required to fully participate in the job application or interview process, to perform the essential functions of the position, and/or to receive all other benefits and privileges of employment, please contact Human Resources at 678-417-8110.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Psychometrician I — Data-Driven Exam Analytics
Psychometrician I — Data-Driven Exam Analytics

National Commission On Certification Of Physicians • Johns Creek (GA)

Remote
USD 82,000 - 98,000
Senior Exam Content Developer
Senior Exam Content Developer

National Commission On Certification Of Physicians • Johns Creek (GA)

On-site
USD 96,000 - 108,000
Senior Exam Content Developer
Senior Exam Content Developer

NATIONAL COMMISSION ON CERTIFICATION OF PHYS • Johns Creek (GA)

Hybrid
USD 96,000 - 108,000
Software & Data Quality Assurance Analyst I
Software & Data Quality Assurance Analyst I

National Commission on Certification of Physician Assistants (NCCPA) • Johns Creek (GA)

Remote
USD 55,000 - 75,000
Meeting & Events Coordinator
Meeting & Events Coordinator

National Commission On Certification Of Physicians • Johns Creek (GA)

Hybrid
USD 44,000 - 65,000
Psychometrician, Measurement & Testing
Psychometrician, Measurement & Testing

ADP, Inc. • Chicago (IL)

On-site
USD 96,000 - 126,000
Psychometrician, Measurement & Testing
Psychometrician, Measurement & Testing

National Council of State Boards of Nursing, Inc. • Chicago (IL)

On-site
USD 96,000 - 126,000
Senior Psychometrician
Senior Psychometrician

NBME • Philadelphia

Remote
USD 139,000 - 173,000
Remote friendly workplace
Healthcare benefits
401(k) with match
+2
Communications Team Lead
Communications Team Lead

National Commission on Certification of Physician Assistants (NCCPA) • Johns Creek (GA)

Hybrid
USD 71,000 - 91,000
Meaningful work
Flexible hybrid work environment
Ranked as a top workplace
Senior Psychometrician
Senior Psychometrician

National Board of Medical Examiners • Philadelphia

Remote
USD 139,000 - 173,000
Remote friendly workplace
Healthcare plans
401(k) match
+2