Language Testing Specialist

Doist; Washington (District of Columbia); On-site; USD 90,000 - 120,000; Full time

Job summary

Doist is seeking a Language Testing Specialist to help develop and review test items for large-scale English language proficiency assessments.

The role involves aligning items with standards, coordinating with external consultants, and analyzing pilot data to drive revisions. Strong writing and collaboration across teams are essential, with a focus on accuracy and clarity in test materials.

Qualifications

• Develop, review and revise test items aligned to item specs.
• Provide feedback to consultants and team members on item development.
• Write and refine graphics descriptions to support item comprehension.

Responsibilities

• Research and write test items aligned to item specifications.
• Evaluate and revise test materials based on stakeholder feedback.
• Write and refine graphics descriptions to aid student understanding of items.
• Coordinate item development tasks with external consultants to ensure timely delivery.
• Incorporate feedback from project managers and experts at multiple development stages.
• Analyze pilot and field test data to inform revisions or new item development.
• Prepare training samples and scoring notes for raters of speaking and writing responses.

Skills

Test item development

Qualitative analysis

Graphics descriptions

Communication

Collaboration

Tools

Spreadsheets

Job description

The Language Testing Specialist plays a critical role in developing, reviewing, and revising test items for WIDA ACCESS and WIDA Screener, large-scale English language proficiency assessments for multilingual learners in grades 1-12.This position involves development of test items (linguistic content, graphics descriptions, scripts) that align to the WIDA English Language Development Standards Framework; implementing stakeholder feedback on the items; conducting qualitative analyses of student responses to items; conducting internal reviews, proofing, and mock administrations of test materials; selecting training responses for use in scoring; and quality control checks of test items prior to delivery and live administration.

ESSENTIAL DUTIES:

• Research and write test items aligned to item specifications and revise based on feedback from test development content managers
• Evaluate, review, and revise test materials and documents, including providing feedback to both external consultants and fellow team members on test item development
• Write and refine graphics descriptions to support student comprehension of test items
• Evaluate and track changes to graphics for content accuracy and grade-level appropriateness
• Prepare materials for internal and external reviews of test materials
• Coordinate item development tasks of external consultants (theme generators, item writers, standards experts, etc.) to ensure timely delivery of test items
• Incorporate item feedback from project managers, clients, and other subject matter experts (standards experts, bias/sensitivity & content reviewers, etc.) at multiple stages of development
• Analyze data from small scale pilot activities with new items; use teacher and student feedback to make revisions
• Analyze and interpret field test data to inform revisions to items or new item development
• Communicate and collaborate within and across teams throughout the test development process
• Adhere to quality control procedures for print and computer-delivered items
• Prepare and maintain files and records (summary reports, electronic notes, spreadsheets, etc.)
• Write and revise test item specifications
• Maintain test item database
• Prepare training samples, annotations, and scoring notes for raters of speaking and writing responses