Assessment Analyst

Kids for the Future; Saint Paul (MN); Hybrid; USD 68,000 - 80,000; Full time

Benefits offered by this job

Health insurance

Retirement contributions

Paid time off

Job summary

The American Registry of Radiologic Technologists (ARRT) is seeking an Assessment Analyst to join our growing team in Minnesota. This hybrid, FT exempt role combines onsite collaboration at our Mendota Heights office about 50% of the time with standard weekday hours, 8:00 a.m. to 4:30 p.m.

You will transform complex data into actionable insights supporting ARRT's credentialing programs, assisting with assessment operations, examination development, program evaluation, and strategic initiatives.

Qualifications

• Master’s degree or higher in psychology (I/O, cognitive, education, research methods, assessment design), data science, statistics, economics, or related field.
• Experience with data analysis and accessing data from a database (SQL).
• Proficiency in Excel.
• Two years of experience, preferably within a non-profit, certification environment; or relevant field.
• Strong understanding of statistical methods and data integrity practices.
• Familiarity with survey design and analysis.
• Experience and/or education focused on working with assessment data (item-level statistics, exam forms, psychometric outputs, etc.).

Responsibilities

• Design assessment blueprints and work with assessment teams.
• Write assessment design training documents for various groups.
• Document technical aspects of exams and reports.
• Collaborate with staff to improve and automate assessment processes.
• Develop research programs to evaluate assessment characteristics in the field.
• Manage and operate the system for processing scores.
• Provide backups for psychometric tasks as needed.
• Build dashboards and data visualizations for internal/external stakeholders.
• Translate findings into actionable recommendations.
• Prepare annual examination reports and participate in standard setting studies.

Skills

Data analysis

SQL

Excel

Communication

Statistics

Detail-oriented

Collaboration

Education

Master's in psychology

Data science

Tools

Power BI

Tableau

WINSTEPS

R

Job description

• Location 1255 Northland Drive,Saint Paul, MN, 55120,United States
• Job Category Data Analyst, Assessments
• Employee Type FT Exempt

The American Registry of Radiologic Technologists (ARRT) is seeking an Assessment Analyst to join our growing team. This hybrid role offers the opportunity to collaborate onsite at our Mendota Heights office approximately 50% of the time and follows a standard full-time schedule of Monday through Friday, 8:00 a.m. to 4:30 p.m.

In this role, you will transform complex data into actionable insights that support ARRT's mission and inform key organizational decisions. You will contribute to assessment operations, examination development, program evaluation, and strategic initiatives, helping ensure the validity, quality, and effectiveness of ARRT's credentialing programs.

Duties and Responsibilities

Assessments

• Workwithassessment team todesignassessment blueprints
• Workwithassessmentdeveloperstoaligncontentwithinassessment blueprints
• Writeassessmentdesigntrainingdocumentsforvariousgroupsusingappropriate style
• Document technicalaspectsofexamsincludingitemperformance, p racticeanalysis procedures, and standard setting reports
• Collaboratewithstafftoimproveandautomateprocessesforassessment activities
• Createresearchprogramstoevaluateassessmentcharacteristicsinthe field
• Manage and operate the system for processing scores in a timely fashion
• Providebackupsupportforpsychometriciansintasksas needed

Data Management and Analysis

• Collect, clean, validate, and transform large datasets from certification systems, assessment platforms, CRM databases, and external sources
• Conduct descriptive and inferential statistical analyses to support certification program validity, exam performance reviews, and candidate experience improvements
• Build dashboards, reports, and data visualizations for internal and external stakeholders
• Exhibit Data Stewardship: Understand where data is, how to access it, and how it can be used

Reporting and Communication

• Develop written and visual reports for leadership, committees, accreditation bodies, and partner organizations
• Translate complex analytical findings into clear, actionable recommendations
• Present data insights to cross-functional teams including, but not limited to, Education Requirements, Marketing and Strategic Communications, Finance, and Information Technology (IT)
• Assist with the designanddevelopment ofAnnualReportsforassessment programs
• Serve as a data liaison between departments

Data Infrastructure and Quality

• Partner with IT to improve data pipelines, data quality, and overall system reliability.
• Document data definitions, processes, and best practices
• Ensure compliance with data privacy standards and accreditation requirements (e.g., NCCA, ISO/IEC 17024)

Assessment Content and Eligibility Materials

• Contribute to periodic practice analysis projects for assigned programs, including survey development, data analysis, and report writing
• Contribute to the development and maintenance of the item bank quality metrics
• Assist with the development of procedures for a more standard presentation of practice analysis survey data where possible and incorporate documentation on those processes into the Practice Analysis Manual

Assessment Scoring, Analysis, and Reporting

• Process exam results and conduct quality control (QC) for a variety of programs
• Conduct exam results processing, scoring, and QC for all programs
• Maintain procedures manual and other documentation required for exam processing and scoring
• Analyze exam results and collaborate with department staff in production and dissemination of annual examination summary reports and technical reports
• Recommend enhancements to scoring procedures and reports
• Analyze data to support department(s)
• Collaboratetocreatesoftwaretoolsthatdirectlyfacilitateor automate psychometric work responsibilities
• Continuously watchfor , communicate, and seek validation of areasof quality improvement by initiating discussions and participating in evaluation of improved processes
• Write,review,oreditotherARRTdocumentsasrequested,includingwebsite material
• AssistwithorpreparememosandreportsforpresentationtotheBoardofTrustees
• Assistwithstandardsettingstudies,as needed
• Support organizational priorities through active participation in ARRT Projects as assigned.
• Proactively manage and deliver assigned ARRT project work.
• Other duties as assigned and modified as business needs dictate.

Requirements

Minimum Qualifications

• Master’s degree or higher in psychology (I/O, cognitive, education, research methods, assessment design), data science, statistics, economics, or related field
• Experience with data analysis and accessing data from a database (SQL)
• Proficiency in Excel
• Two years of experience, preferably within a non-profit, certification environment; or relevant field
• Strong understanding of statistical methods and data integrity practices
• Familiarity with survey design and analysis
• Experience and/or education focused on working with assessment data (item-level statistics, exam forms, psychometric outputs, etc.)

Preferred Qualifications

• Experience with data visualization tools (Power BI, Tableau, or similar)
• Understanding of accreditation frameworks (NCCA, ANSI/ISO 17024)
• Knowledge of CRM systems
• Assessmentdevelopment experience includingrequirementsandcontent specification

Skills and Abilities

• Excellent interpersonal, verbal, and written communication skills with demonstrated ability to communicate in a clear, concise, and professional manner with the ability to collaborate across groups to build and maintain relationships
• Ability to evaluate and establish priorities
• Research, interpret, explain, present, and apply complex procedures, rules, and regulations
• Communicate and manage detailed, sensitive, and confidential information appropriately
• Proficiency in psychometric concepts, tools, techniques, and best practices
• Adaptability and flexibility, with the ability to respond to changing needs of the position, department, and organization.
• Professional development participation to remain current with industry best practices.
• Proven ability to apply critical thinking and problem-solving skills to analyze, simplify, and translate complex business problems and apply the appropriate level of planning, organization, and structure to drive results to multiple levels in the organization
• Demonstrated ability to utilize and understand Microsoft 365 office products
• Experience with R, SQL, IRT calibrations, item analysis software applications (e.g., WINSTEPS), assessment engineering
• Familiarity with multiple data collection techniques including, but not limited to, operational, survey, etc.
• Openness to learning machine learning models

Physical Demands

• Close Visual Acuity: Preparing and analyzing data; viewing a computer screen; and extensive reading
• Fingering: Typing, or otherwise working, primarily with fingers
• Hearing: Ability to receive detailed information through oral communication, and to make fine discriminations in sound.
• Reaching: Extending hand(s) and arm(s) in any direction.
• Repetitive Motions: Substantial movements (motions) of the wrists, hands, and/or fingers
• Sedentary Work: Sitting most of the time; occasional walking and standing
• Talking: Spoken word activities can be relayed accurately, loudly, or quickly

Summary

The American Registry of Radiologic Technologists (ARRT) is a leading credentialing organization. ARRT offers certification and registration in a wide range of radiologic disciplines, helping people who work in medical imaging and radiation therapy to develop their careers. With nearly 360,000 registrants, we promote high standards of patient care with each new credential we award. Visit www.arrt.org for more information and for details on ourbenefit offerings.

• including health insurance, retirement contributions, paid time off, and more.

Pay range is $ 67,905 -$79,889 annually.