Psychometrician

HMH; Massachusetts; À distance; USD 90 000 - 130 000; Plein temps

Résumé du poste

Houghton Mifflin Harcourt is seeking a Psychometrician to join the PRDA team within Learning Sciences. The role focuses on psychometric analysis, assessment design, growth research, and statistical programming to advance innovative assessments and documented technical aspects of offerings.

The position involves calibration, equating, and IRT work, with opportunities to lead adaptive testing developments and collaborate across projects. Remote work capability is supported within a national scope.

Qualifications

• Experience with IRT calibration, scaling, and equating.
• Experience with computer adaptive testing.
• Strong R programming skills with CAT simulations.
• Ability to visualize data and support score reporting visualization research.

Responsabilités

• Select analyses to demonstrate the psychometric characteristics of assessments.
• Manage large data files and apply statistical analyses using R and related tools.
• Develop and lead computer adaptive testing algorithms including multistage designs.
• Lead quality assurance and reporting procedures for assessment programs.
• Present technical characteristics of tests and contribute to project specifications.
• Support research publications, conference presentations, and journal submissions.

Connaissances

Psychometric modeling

Statistical programming

Research methodology

Data analysis

Adaptive testing

Formation

PhD in psychometrics

Outils

R

WINSTEPS

FlexMIRT

Excel

Description du poste

Select how often (in days) to receive an alert: Create Alert

HMH is looking for a Psychometrician to join the Psychometric Research and Data Analytics (PRDA) team within the Learning Sciences group. Overall, the Psychometrician position will support HMH's assessment design, psychometric analysis, interim assessment and growth research, and statistical programming activities to further the goals of HMH to transform into a learning company through integrating assessment with instructional content. By doing so, the Psychometrician position will be involved with developing, marketing, and improving a set of innovative assessments while providing support toward documenting the technical aspects of HMH's assessment offerings and conducting validity studies.

The Psychometrician will contribute to, and be accountable for and assist with, all technical aspects of assigned projects, including item and test analyses, adaptive algorithm simulation support, growth modeling, IRT calibration, equating, scaling, prediction/forecasting studies, and placement research.

Candidates interested in this position should have a strong working knowledge of and interest in the assessment challenges facing K-12 education, have a collaborative working style, and expertise in psychometric modeling, statistical programming, research methodology, and interest in supporting data analytic initiatives. Candidates must also be able to successfully work in a remote environment workplace.

Primary Responsibilities

• Work with the Manager of Psychometric Research and Data Analytics (PRDA) , Principal Psychometrician, Psychometrician, subject-matter experts, and/or clients/customers to select statistical analyses that will best demonstrate the psychometric characteristics of the various assessment product offering of HMH.
• Manage large and complex data files, apply statistical analysis software such as R, and potentially utilize IRT calibration software, and be familiar with dedicated R packages supporting psychometric modeling.
• Conduct analyses and create visual displays to lead interpretation of the data. Assist in leading the development of computer adaptive testing algorithms, which includes on-the-fly multistage adaptive designs and automated test assembly.
• Initiate, plan, and select, appropriate statistical and psychometric methodologies involved in the accurate scoring, analysis, and reporting of assessment programs. Identify issues and risks in data and psychometric analyses and create plans to mitigate the risk. Lead efforts on quality assurance and quality checking procedures.
• Initiate and lead procedures for presenting technical characteristics of tests and evaluates the extent to which product development activities will result in sound assessment products. Make recommendations to improve the robustness of assessments.
• Supports the HMH research agenda by managing, collecting, and organizing journal articles, reports, and other documents, and analyzing student assessment data for various research projects, conference presentations, and papers for publication
• Investigate quality control mechanisms that help ensure the consistent production of items and test forms
• May lead and work with a team to ensure that procedures for meeting test development standards are included in project and research specifications.
• Able to independently implement a research study design and follow analysis specifications provided by senior team members.
• Serve as the point of contact for internal and external customers regarding the technical characteristics of current tests or those under development.
• Collaborate with colleagues to coordinate work with large and/or multiple projects and ability to negotiate schedules with project management staff while conforming to the Agile practices.
• Demonstrate project management skills necessary to lead all PRDA-related aspects of a small-to-medium operational assessment program or research project, or a portion of a large and complex assessment program or research project
• Demonstrate communication skills (oral, written, and business) necessary to function effectively as a primary contact with internal project teams and external clients with guidance from more senior staff
• Conduct operational and theoretical research to produce internal white papers, conference presentations, and journal publications.
• Ability to develop and implement simulation studies investigating assorted measurement issues a plus.

Education and Experience

• Doctorate in psychometrics, educational measurement, statistics or closely related content area
• 0-1 years' experience working in a testing-related field with demonstrable experience in solving psychometric problems and providing solutions
• Demonstrated professional achievement through presentations at professional conferences and/or publications in professional journals is a plus. Strong R programming skills with ability to conduct CAT simulations research is a plus. Interest in visualizing data and supporting score reporting visualization research is a plus.

Knowledge and Skills

• Experience with IRT calibration, scaling, equating, and growth measures
• Experience with computer adaptive testing
• Simulations experience with CAT, multi-stage testing and/or automated test assembly is preferred
• Knowledge of technical requirements, test statistics, and APA/AERA Standards and ability to perform psychometric analyses that meet all professional standards of test development and score uses
• Knowledge of support tools such as Microsoft Office/EXCEL, experience with computer software packages commonly used in psychometric work and research (e.g., R, WINSTEPS, FlexMIRT).
• Demonstrated ability to analyze large data sets efficiently
• Ability to apply knowledge gained through experience in test development to prepare project specifications, anticipate implementation problems, and support the projects through to completion
• Demonstrate strong organizational and communication skills and be able to function independently and collaboratively on research projects
• Ability to adapt test theory for practical applications
• Approaches testing and assessments problems with an analytical, flexible, and investigative mind
• Strong organizational and communication skills

Physical Requirements

• Might be in a stationary position for a considerable time (sitting and/or standing)
• Constantly operates a computer and other office productivity machinery, such as a calculator, copy machine, and computer printer
• Must be able to collaborate with colleagues via face to face, conference calls, and online meetings
• Travel to meetings and conferences as needed (less than 10%)

ABOUT US: Houghton Mifflin Harcourt (NASDAQ:HMHC) is a global learning company dedicated to changing people's lives by fostering passionate, curious learners. As a leading provider of pre-K-12 education content, services, and cutting-edge technology solutions across a variety of media, HMH enables learning in a changing landscape. HMH is uniquely positioned to create engaging and effective educational content and experiences from early childhood to beyond the classroom. HMH serves more than 50 million students in over 150 countries worldwide, while its award-winning children's books, novels, non-fiction, and reference titles are enjoyed by readers throughout the world. For more information, visit http://careers.hmhco.com

PLEASE NOTE: Houghton Mifflin Harcourt is an equal employment opportunity employer and participates in E-Verify. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of gender, race/ethnicity, gender identity, sexual orientation, protected veteran status, disability, or other protected group status.

Job Segment: Market Research, Web Design, Media Publishing, Marketing, Education, Creative, Publishing