Test Construction Analyst

ZipRecruiter; Philadelphia (Philadelphia County); Remote; USD 60,000 - 85,000; Full time

Job summary

NBME is seeking two Test Construction Analysts to join their Test Development team, focusing on critical analysis and test construction for major medical licensing exams. This project-based role, primarily remote, offers comprehensive benefits and requires expertise in data analysis, programming, and technical communication.

Qualifications

• 3 to 5 years of relevant experience with programming.
• Ability to translate technical information to non-technical individuals.
• Some knowledge of assessment processes like Item Response Theory.

Responsibilities

• Perform data extraction and analysis for test construction.
• Automate test form assembly and monitor new technology implementation.
• Create and disseminate documentation for procedures.

Skills

Data analysis

Communication

Problem-solving

Attention to detail

Technical proficiency

Education

Bachelor's Degree

Tools

R

Python

Excel

SQL

Job description

Job Description

POSITION OVERVIEW

NBME is excited to announce an opportunity for two Test Construction Analysts to join our dynamic Test Development team. In this project-based role, you'll be responsible for providing critical analysis, test construction, publication services, and system support across a range of high-impact examination programs. These include the United States Medical Licensing Examination (USMLE), North American Veterinary Licensing Examination (NAVLE), Medical School Services, and NBME Self-Assessment Services. This is a unique chance to contribute to the quality and integrity of exams that shape the future of healthcare and veterinary professionals. While this is a project role expected to last between 18 to 24 months, individuals hired into this position will be eligible for the same comprehensive benefits as regular NBME employees.

This role has been designated as primarily remote, meaning it requires little to no onsite attendance. While this role can be designated as remote, you are offered the flexibility to select if you prefer to work primarily remotely, hybrid, or onsite. We're open to considering candidates within 50 miles of our office location in Philadelphia, PA.

Equity and Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the healthcare community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, including professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. We also focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products, and services, the Philadelphia community, and the broader medical education landscape.

RESPONSIBILITIES

• Perform analyses by extracting data from our databases and data warehouses using R to generate results.
• Communicate results to non-technical members of the organization.
• Execute automated assembly of test forms.
• Analyze the statistical and content characteristics of the new forms using R, Python, and Excel.
• Create, update, and disseminate documentation for new and existing technological procedures and routines, including direct user support and training.
• Collaborate with other units in the research, design, and testing of new technology and software.
• Monitor implementation of new technology, systems, and software.

QUALIFICATIONS

Skills and Abilities

• Significant expertise with software applications supporting data analysis/warehousing (R, Python, C#, Excel, SQL, CPLEX).
• Excellent interpersonal and communication skills, including the ability to "translate" technical information to non-technical individuals.
• Strong attention to detail and problem-solving skills.
• Ability to learn and apply new technology quickly.
• Ability to set priorities consistent with unit goals.
• Some knowledge of and experience with the scholarly research process.

Experience

• 3 to 5 years of relevant experience with programming at the level of the business unit.
• Previous exposure to or knowledge about assessment, Item Response Theory (IRT), and Psychometrics.
• Knowledge of automated processes with complex data, like Automated Test Assembly (ATA).

Education

• Bachelor's Degree

About NBME:

NBME is a not-for-profit organization that specializes in creating assessments and learning tools for physicians and health professionals. Our mission is to advance assessment of these professionals to achieve optimal care for all, supporting the development of a highly effective, diverse, and compassionate healthcare workforce. Founded in 1915, NBME develops and manages the United States Medical Licensing Examination with the Federation of State Medical Boards. We offer a comprehensive portfolio of assessment products for every stage of the medical school journey and provide assessment services to various health profession organizations. We are dedicated to advancing innovative assessment approaches through research, collaboration, and contributions to the medical education and assessment communities. In 2024, we expanded our assessment capabilities to include simulation through the acquisition of MedVR Education. Learn more on NBME's website.

NBME's Community Collaborations and Contributions

NBME believes that a key path to meeting our mission is collaborating with and supporting our communities. Our Community Collaborations and Contributions programs provide resources and recognition to medical educators and researchers advancing the field of assessment throughout their careers. In addition, we invest in scholarships and pathway programs to aid learners and support increased representation in healthcare. Headquartered in Philadelphia, NBME also contributes to local organizations that promote health equity and access and positively impact social determinants of health.

#LI-Remote

#Associate

Job Posted by ApplicantPro