Senior Measurement Scientist

NBME; Philadelphia, San Francisco (Philadelphia County, CA); Remote; USD 138,000 - 174,000; Full time

Job summary

An established industry player is seeking a Senior Measurement Scientist to innovate healthcare assessments. This role involves developing novel evaluation tools and conducting psychometric research to enhance the quality of medical education. You will collaborate with diverse professionals, leveraging your expertise in educational measurement and assessment. This position offers a supportive environment focused on diversity, equity, and inclusion, making it an exciting opportunity to impact the future of healthcare assessments significantly. Join a team dedicated to advancing medical education and assessment science.

Benefits

Healthcare plans

Dental plans

Vision plans

401(k) with match

Tuition reimbursement

Commuter benefit

Remote friendly workplace

Qualifications

• Strong background in educational and psychological assessment.
• Experience developing performance-based assessments and learning tools.

Responsibilities

• Plan and execute research programs for novel healthcare assessments.
• Design studies to improve test design and scoring for medical examinations.

Skills

Educational assessment and measurement

Psychological assessment

Reliability and validity concepts

Performance-based assessments

Excellent communication skills

Education

Doctorate in educational/psychological measurement

Job description

POSITION OVERVIEW

The Office of Research Strategy (ORS) at the NBME is currently seeking a Senior Measurement Scientist to join its team. ORS is responsible for developing next-generation assessments and conducting psychometric research related to these assessments. Areas of research and development in which ORS is involved include the assessment of professional competencies such as communication skills and clinical reasoning, technology-based assessments including simulations, and psychometric applications in the education, training, and credentialing of healthcare professionals including foci on construct development, validity issues, complex item-response theory models, and multilevel and structural equation modeling techniques.

This researcher will apply strong critical thinking skills and a working knowledge of best practices to the development of novel assessments of healthcare professionals.

Diversity, Equity, and Inclusion Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the healthcare community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community and the broader medical education landscape.

RESPONSIBILITIES:

• Plan and execute programs of research aligned with the ORS research agenda that center around the development of novel assessments for healthcare professionals

• Oversee and provide services to the measurement/medical education community by acting as reviewer or editor for professional journals and/or conference submissions and actively participating in professional conferences as presenter and discussant.

• Design studies and conduct analyses to improve test design and development, and scoring and score reporting for medical licensing examinations and related assessment programs;
• Provide psychometric consultation; and
• Contribute to the educational measurement community via professional presentations or publications related to independent or organizational research agendas.

QUALIFICATIONS:

Skills and Abilities

• Strong background in educational assessment and measurement, and/or in psychological assessment, including a well-developed understanding of issues of reliability, validity and other quantitative concepts of test and assessment quality; and
• Experience in developing assessments for a variety of purposes and uses, including formative purposes; and
• Experience developing performance-based assessments and learning tools, such as simulation-based assessments, and incorporating the latest technologies into the assessment design; and
• Demonstrated ability to define, develop, and execute approaches to assess and provide feedback on skill and behavior constructs important in medical education, particularly patient-centered communication skills; and
• Excellent oral and written communication skills as well as outstanding interpersonal skills, including the ability to work closely and successfully with individuals from a variety of professional and educational backgrounds.

Experience

• Minimum 5 years of experience

Education

• Doctorate in educational/psychological measurement, industrial/ organizational psychology, cognitive psychology or related field;

About NBME:

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators. These include the volunteers who help develop our exam questions, the committees and panels who represent various groups within the medical education community, external researchers and health profession organizations.

We are committed to meeting the needs of educators and learners globally with assessment products and expert services such as NBME Subject Examinations, Customized Assessment Services, Self-Assessments, the International Foundations of Medicine Program and Item Writing Workshops. Together with the Federation of State Medical Boards, NBME develops and manages the United States Medical Licensing Examination, which measures the ability to apply knowledge and skills that form the basis of safe and effective patient care. Our Competency-based Assessment unit is focused on new methods as well as the optimization of assessment in the workplace and education.

As a result of leadership in ongoing research, innovative measurement practices and the exploration of forward-thinking assessment modalities and improvements, NBME advances assessment science. Our grant and funding opportunities further support this dedication to medical education and assessment science. We help develop the next generation of assessment professionals through our Summer Psychometric Internship Program. Through the Stemmler Fund, Strategic Educators Enhancement Fund and Latin America Grants Program, researchers and educators can continue to improve the assessment of health care professionals around the world.

NBME views diversity, equity and inclusion (DEI) as foundational and enduring to our strategy and vision. We continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, culture, products and services, the Philadelphia community and the broader medical education landscape. Our commitment manifests in our hiring and staff development, recruitment for committees, grants programs, design and review of our assessments, and involvement in our local and national communities.

Learn more about NBME at NBME.org.

Compensation we are offering for this position is at $138,688 - $173,360/year. Please note that the offered rate for this position typically aligns with the minimum to midrange of this grade, but it can vary based on the successful candidate's qualifications and experience, department budget, and an internal equity review.

The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. Excellent Benefits include: Healthcare, Dental, Prescription, and Vision plans; 401(k) w/match, Tuition Reimbursement Plan, Commuter Benefit: Public Transit or Parking options. Remote Friendly Workplace.

NBME is an Equal Opportunity Employer. We will consider all qualified applicants for employment without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.