Test Development Coordinator

International Council for Veterinary Assessment; Lawrence (KS); On-site; USD 65,000 - 95,000; Full time

Benefits offered by this job

Medical and dental insurance

Retirement program

Educational and professional develop.

Job summary

University of Kansas (ATLAS) is seeking an English Language Arts Test Development Coordinator to support the production of assessment forms from item authoring to field testing. The role emphasizes validity, fairness, and alignment with curricular standards for K-12 and students with significant disabilities.

The candidate will apply NG ELA Standards and evidence-centered design to guide item development, review, and test forms within a collaborative team.

Qualifications

• Excellent close reading skills across diverse texts and genres.
• Excellent written communication skills in English.
• Experience applying NG ELA Standards to instruction, curriculum, or assessment.
• Experience designing/ developing standardized assessments in an item management platform.
• Proficient with Microsoft Office and web-based collaboration tools.

Responsibilities

• Ensure validity, fairness, and quality assurance for items; refine items with standards.
• Guide task models based on Evidence Centered Design principles for ELA items.
• Resolve external feedback on test items and forms.
• Contribute to trainings/orientations for item writers and reviewers.
• Improve processes and documentation to enhance content validity.

Skills

Close reading

Written communication

Microsoft Office

Education

Bachelor's degree in English or related field

Master's degree in related field

Tools

Skype/Zoom

Item management systems

Job description

Position Overview

Accessible Teaching, Learning, and Assessment Systems (ATLAS), a research center at the University of Kansas (KU), is seeking an English Language Arts Test Development Coordinator on our Test Development Team. The Test Development Coordinator will support and guide the production of operational, standards-based assessments by participating in test development efforts. These efforts span from initial item authoring through all stages of item refinement, review and field testing to final operational test forms construction. The Test Development Coordinator will primarily focus on ensuring that ELA assessment items support valid interpretations of test scores, adhere to industry best practices, and appropriately elicit observable evidence of targeted cognition as described by curricular standards for both general populations and for students with the most significant cognitive disabilities.

Successful applicants will demonstrate deep and thorough expertise with the Next Generation ELA Standards and will be familiar with a range of either classroom approaches and/or standardized assessment approaches to collecting evidence of student mastery of curricular standards. ATLAS applies principles of Evidence Centered Design (ECD) to its test design and development processes. Therefore, expertise and the ability to provide thought leadership to other members of the ELA team with regard to these principles in an assessment context is a plus.

ATLAS promotes learning and improved outcomes for all students, with a focus on students with disabilities and struggling learners. ATLAS creates technology-based learning and assessment systems that are accessible and academically rigorous. Dynamic research on skill development, assessment design, and teacher professional development informs the center's map-based learning systems.

With a diverse portfolio of grant-funded research projects and operational alternate assessments, ATLAS is a leader in educational research and innovation. ATLAS drives progress through partnerships and collaborations with organizations that share its focus and commitment.

ATLAS is committed to creating policies and practices that foster a culture in which all employees feel they belong and can succeed.

Visit the ATLAS website to learn how the center improves the learning landscape for all students.

KU employees have great benefits!

• 176 hours of paid vacation per year
• 96 hours of sick leave per year
• 10 paid holidays
• Medical and dental insurance
• Retirement program
• Life and disability insurance
• Educational and professional development opportunities

Visit the KU benefits website for more information.

KU's excellence is a result of the rich tapestry of experiences, perspectives, and backgrounds of our faculty, staff, students, and colleagues from across our nation and the globe. At KU we invest in continuous learning and growth by creating a climate where people engage in respectful dialogue and debate and support each other's success. We foster a culture of care where each person is valued. When people feel a true sense of belonging, we believe they are better able to reach their full potential and achieve remarkable things.

KU is not able to provide immigration sponsorship for this position.

Due to complex state employment laws, the University of Kansas may be unable to hire fully remote workers for this position outside of Kansas. Specifically, we cannot currently offer employment to candidates residing in the following states: California, Delaware, Idaho, and Minnesota. We appreciate your understanding and invite interested individuals from eligible states to apply.

Job Description

55% - Ensure expectations for validity, fairness, and quality assurance for items are met. Activities may include

• Reviewing and refining items written by external item writers in accordance with established standards of quality and internally and externally imposed deadlines.
• Contributing to the development of task models and construct definitions based in Evidence Centered Design principles, and guiding the ELA team to apply the task models consistently when reviewing items.
• Helping to resolve external, expert feedback on test items and test forms.
• Contributing to the design of trainings and orientations for item writers, internal staff, and external reviewers.
• Contributing to the identification, analysis, and improvement of existing processes and documentation to improve content validity.

35% - Coordinate and organize test development efforts, processes, and documentation. Activities may include

• Collaborating on test and item designs for innovative ELA assessments.
• Coordinating workflow for ELA content at multiple stages of the test development process.
• Contributing to the management of the test item pool.
• Assembling and/or reviewing field test and operational test forms to meet blueprint, test design, and psychometric criteria.
• Contributing to the identification, analysis, and improvement of existing processes and documentation to improve efficiency or meet best practice standards.
• Preparing, reviewing, and editing test blueprints, performance level descriptors, responses to RFPs, and technical reports.
• Collaborating with the psychometric and technology teams to create ancillary testing materials, such as interpretive guides, score reports, and website documents.

5% - Contribute subject matter expertise to grant-funded projects led by Lead Researchers and Principal Investigators. 5% - Special projects/other duties as assigned.

Required Qualifications

1. Bachelor's degree in English Literature, Comparative Literature, Writing, English Language Arts education or related field AND three (3) years standardized assessment development, teaching, large-scale assessment, or curriculum development experience OR master's degree AND one (1) year of standardized assessment development, teaching, large-scale assessment, or curriculum development experience.
2. One (1) year of experience applying knowledge of the Next Generation ELA Standards (such as the Common Core State Standards for English Language Arts/Literacy) to instruction, curriculum or assessment.
3. One (1) year of experience designing or developing standardized assessments in an item management and delivery platform that includes functionality for item authoring, editing and review.
4. One (1) year of experience using technology including Microsoft Office products, Skype, Zoom, and/or other web-based systems as evidenced in application materials.
5. Excellent close reading skills as applied to a wide range of textual materials, including but not limited to technical materials, literature appropriate for all grades K-12, and theoretical research and as evidenced by work history and relevant coursework.
6. Excellent written communication skills in English as evidenced by application materials.

This position requires a formal degree in the cited discipline area(s) to ensure that candidates have advanced knowledge, analytical skills and professional competencies necessary to perform the duties of the position. The level of degree is commonly recognized as the standard qualification for similar roles in the public and private sector, ensuring that the university remains competitive with industry aligned practices, enhances collaboration with external partners, and supports the delivery of services and programs that meet professional and market-driven expectations.

Additional Candidate Instruction

1. The University of Kansas online application
2. A cover letter that describes how you meet the required and preferred qualifications
3. A Resume or CV
4. Contact information for three (3) professional references

Incomplete applications will not be considered.

Application review begins Tuesday, July 7th and will continue until a qualified pool of applicants is identified.

Disclaimer

The University of Kansas prohibits discrimination on the basis of race, color, ethnicity, religion, sex, national origin, age, ancestry, disability, status as a veteran, sexual orientation, marital status, parental status, gender identity, gender expression, and genetic information in the university's programs and activities. Retaliation is also prohibited by university policy. The following person has been designated to handle inquiries regarding the nondiscrimination policies and procedures and is the Title IX Coordinator for all KU and KUMC campuses: Associate Vice Chancellor for the Office of Civil Rights and Title IX, [e-mail], Room 1082, Dole Human Development Center, 1000 Sunnyside Avenue, Lawrence, KS 66045, 785-864-6414, 711 TTY. Reports can be submitted by contacting the Title IX Coordinator as provided herein or using the Title IX online report form and complaints can be submitted with the Title IX Coordinator or using the Title IX online complaint form.