Test Development Coordinator

University of Kansas; Lawrence (KS); On-site; USD 60,000 - 80,000; Full time

Benefits offered by this job

Paid vacation (176 hours per year)

Sick leave (96 hours per year)

Medical and dental insurance

Retirement program

Educational opportunities

Job summary

The University of Kansas is seeking an English Language Arts Test Development Coordinator to join our Test Development Team at the ATLAS research center. This role focuses on supporting standards-based assessments and ensuring adherence to best practices.

Qualified candidates will have a relevant Bachelor's degree and experience in assessment development. Benefits include paid vacation, medical insurance, and educational opportunities.

Qualifications

• 3 years experience in standardized assessment development or related field if holding a Bachelor's degree.
• 1 year experience in standardized assessment design in an item management platform.
• Experience with large-scale assessment and curriculum development.

Responsibilities

• Ensure validity and quality assurance of assessment items.
• Coordinate and organize test development processes.
• Contribute subject matter expertise to grant-funded projects.

Skills

Knowledge of Next Generation ELA Standards

Excellent written communication skills

Close reading skills

Experience with Microsoft Office and web-based systems

Education

Bachelor’s degree in English Literature or related field

Job description

Position Overview

Accessible Teaching, Learning, and Assessment Systems (ATLAS), a research center at the University of Kansas (KU), is seeking an English Language Arts Test Development Coordinator on our Test Development Team. The Test Development Coordinator will support and guide the production of operational, standards-based assessments by participating in test development efforts. These efforts span from initial item authoring through all stages of item refinement, review and field testing to final operational test forms construction. The Test Development Coordinator will primarily focus on ensuring that ELA assessment items support valid interpretations of test scores, adhere to industry best practices, and appropriately elicit observable evidence of targeted cognition as described by curricular standards for both general populations and for students with the most significant cognitive disabilities.

Job Responsibilities

55% - Ensure expectations for validity, fairness, and quality assurance for items are met. Activities may include:

• Reviewing and refining items written by external item writers in accordance with established standards of quality and internally and externally imposed deadlines.
• Contributing to the development of task models and construct definitions based in Evidence Centered Design principles, and guiding the ELA team to apply the task models consistently when reviewing items.
• Helping to resolve external, expert feedback on test items and test forms.
• Contributing to the design of trainings and orientations for item writers, internal staff, and external reviewers.
• Contributing to the identification, analysis, and improvement of existing processes and documentation to improve content validity.

35% - Coordinate and organize test development efforts, processes, and documentation. Activities may include:

• Collaborating on test and item designs for innovative ELA assessments.
• Coordinating workflow for ELA content at multiple stages of the test development process.
• Contributing to the management of the test item pool.
• Assembling and/or reviewing field test and operational test forms to meet blueprint, test design, and psychometric criteria.
• Contributing to the identification, analysis, and improvement of existing processes and documentation to improve efficiency or meet best practice standards.
• Preparing, reviewing, and editing test blueprints, performance level descriptors, responses to RFPs, and technical reports.
• Collaborating with the psychometric and technology teams to create ancillary testing materials, such as interpretive guides, score reports, and website documents.

5% - Contribute subject matter expertise to grant-funded projects led by Lead Researchers and Principal Investigators.

5% - Special projects/other duties as assigned.

Required Qualifications

1. Bachelor’s degree in English Literature, Comparative Literature, Writing, English Language Arts education or related field AND three (3) years standardized assessment development, teaching, large-scale assessment, or curriculum development experience OR master’s degree AND one (1) year of standardized assessment development, teaching, large-scale assessment, or curriculum development experience.
2. One (1) year of experience applying knowledge of the Next Generation ELA Standards (such as the Common Core State Standards for English Language Arts/Literacy) to instruction, curriculum or assessment.
3. One (1) year of experience designing or developing standardized assessments in an item management and delivery platform that includes functionality for item authoring, editing and review.
4. One (1) year of experience using technology including Microsoft Office products, Skype, Zoom, and/or other web-based systems as evidenced in application materials.
5. Excellent close reading skills as applied to a wide range of textual materials, including but not limited to technical materials, literature appropriate for all grades K-12, and theoretical research as evidenced by work history and relevant coursework.
6. Excellent written communication skills in English as evidenced by application materials.

Benefits

• 176 hours of paid vacation per year
• 96 hours of sick leave per year
• 10 paid holidays
• Medical and dental insurance
• Retirement program
• Life and disability insurance
• Educational and professional development opportunities

KU is not able to provide immigration sponsorship for this position.

Due to complex state employment laws, the University of Kansas may be unable to hire fully remote workers for this position outside of Kansas. Specifically, we cannot currently offer employment to candidates residing in the following states: California, Delaware, Idaho, and Minnesota. We appreciate your understanding and invite interested individuals from eligible states to apply.

Disclaimer

The University of Kansas prohibits discrimination on the basis of race, color, ethnicity, religion, sex, national origin, age, ancestry, disability, status as a veteran, sexual orientation, marital status, parental status, gender identity, gender expression, and genetic information in the university's programs and activities. Retaliation is also prohibited by university policy. The following person has been designated to handle inquiries regarding the nondiscrimination policies and procedures and is the Title IX Coordinator for all KU and KUMC campuses: Associate Vice Chancellor for the Office of Civil Rights and Title IX, [e-mail], Room 1082, Dole Human Development Center, 1000 Sunnyside Avenue, Lawrence, KS 66045, 785-864-6414, 711 TTY. Reports can be submitted by contacting the Title IX Coordinator as provided herein or using the Title IX online report form and complaints can be submitted with the Title IX Coordinator or using the Title IX online complaint form.