Senior Measurement Scientist

NBME; Philadelphia (Philadelphia County); Remote; USD 138,000 - 174,000; Full time

Job summary

An innovative organization in the healthcare sector is seeking a Senior Measurement Scientist to develop next-generation assessments. This role involves conducting psychometric research, focusing on professional competencies and technology-based assessments. The ideal candidate will have a strong background in educational measurement and a passion for improving medical education. The company values diversity, equity, and inclusion, aiming to empower talented individuals from various backgrounds. Join a team dedicated to advancing healthcare education and making a meaningful impact through high-quality assessments.

Benefits

Healthcare

Dental Insurance

Vision Insurance

401(k) Matching

Tuition Reimbursement

Remote-Friendly Work Environment

Qualifications

• 5+ years of experience in educational or psychological assessment.
• Strong background in reliability and validity issues.

Responsibilities

• Plan and execute research programs for novel assessments.
• Design studies to improve test design and scoring.

Skills

Educational Assessment

Psychometric Analysis

Communication Skills

Quantitative Assessment Quality

Performance-Based Assessments

Education

Doctorate in Educational/Psychological Measurement

Job description

The Office of Research Strategy (ORS) at the NBME is currently seeking a Senior Measurement Scientist to join its team. ORS is responsible for developing next-generation assessments and conducting psychometric research related to these assessments. Areas of research and development include:

• The assessment of professional competencies such as communication skills and clinical reasoning
• Technology-based assessments including simulations
• Psychometric applications in education, training, and credentialing of healthcare professionals, focusing on construct development, validity issues, complex item-response theory models, and multilevel and structural equation modeling techniques

This researcher will apply strong critical thinking skills and a working knowledge of best practices to develop novel assessments for healthcare professionals.

Diversity, Equity, and Inclusion Statement

At NBME, we innovate and improve to meet the evolving needs of the healthcare community. Our commitment begins and ends with our people. By recruiting and empowering talented individuals from diverse disciplines and backgrounds, including those with varied life experiences, abilities, and perspectives, NBME aims to advance medical education and assessment. We ensure that our DEI efforts are impactful and integrated into our staff, culture, products, services, and community engagement.

Responsibilities:

1. Plan and execute research programs aligned with the ORS agenda, focusing on developing novel assessments for healthcare professionals
2. Oversee and provide services to the measurement and medical education community by acting as reviewer or editor for professional journals and conference submissions, and participating as presenter and discussant
3. Design studies and conduct analyses to improve test design, development, scoring, and reporting for medical licensing examinations and related assessments
4. Provide psychometric consultation
5. Contribute to the educational measurement community through professional presentations or publications

Qualifications: Skills and Abilities

• Strong background in educational or psychological assessment, with understanding of reliability, validity, and other quantitative assessment quality issues
• Experience developing assessments for various purposes, including formative assessments
• Experience creating performance-based assessments and incorporating latest technologies, such as simulations
• Ability to define, develop, and implement approaches to assess and provide feedback on skills and behaviors relevant to medical education, especially patient-centered communication skills
• Excellent communication skills and the ability to collaborate across diverse professional and educational backgrounds

Experience

• Minimum of 5 years of relevant experience

Education

• Doctorate in educational/psychological measurement, industrial/organizational psychology, cognitive psychology, or related fields

About NBME:

NBME offers high-quality assessments and educational services for various stakeholders in medical education and healthcare. We collaborate with volunteers, committees, external researchers, and health organizations to ensure our assessments meet high standards and stay relevant.

We are committed to diversity, equity, and inclusion, integrating these principles into our staff development, assessment design, and community involvement.

Learn more about NBME at our website. Compensation for this position ranges from $138,688 to $173,360 annually, depending on qualifications and experience. We offer competitive salaries, comprehensive benefits including healthcare, dental, vision, 401(k) matching, tuition reimbursement, and a remote-friendly work environment.

NBME is an Equal Opportunity Employer, considering all qualified applicants regardless of race, color, sex, gender identity, sexual orientation, religion, national origin, pregnancy, veteran status, or disability.