Associate Director, AP Music Theory, Curriculum and Assessment

collegeboard; United States; Remote; USD 100,000 - 150,000; Full time

Job summary

College Board - AP&I in a remote setting seeks an Associate Director for AP Music Theory, Curriculum and Assessment. You will oversee the creation, sourcing, and review of musical materials and test questions for the AP Music Theory Exam and formative assessments.

Working with AP Music Theory Course Experts, you will ethically integrate AI in assessment development, train SMEs, and help ensure fair, valid, and innovative exam content while coordinating scheduling and meetings as needed.

Qualifications

• Experience developing and reviewing AP-style assessment materials.
• Ability to integrate AI tools in assessment design.
• Strong collaboration with course experts and external committees.

Responsibilities

• Coordinate creation and review of musical scores and audio for AP Music Theory.
• Set scores in Sibelius and annotate in Illustrator for exam materials.
• Edit audio to specifications using Adobe Audition and related tools.
• Review stimulus materials and assist with permission processes.
• Leverage generative AI to improve assessment quality and efficiency.
• Support in meetings, both in-person and virtual, with AP Test Development Committee.

Job description

Associate Director, AP Music Theory, Curriculum and Assessment

College Board - AP&I

Location: This is a remote role. Candidates who live near College Board offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office). All College Board employees are required to occasionally travel to meet in person for business purposes.

Role Type: This is a full-time position

About the Team

The AP Curriculum and Assessment Team at College Board (125+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP's 43 courses in a wide variety of subject areas. AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level. AP's course teams composed of educators and disciplinary experts ensure that course curricula are aligned to higher education expectations and reflect the state of the art in the discipline, contribute to instructional resources and tools for teachers, and develop assessments that allow students in these courses to demonstrate their mastery of course content and skills. AP leads in strategic use of AI to expand student access, strengthen instructional design and professional support, and enhance assessment creation and exam analysis. The World Languages and Arts department, which includes Spanish Language, Italian Language, French Language, German Language, Chinese Language, Japanese Language, Latin, Music Theory, Spanish Literature, and Art and Design, is currently composed of approximately 27 people supporting 12 courses in the AP portfolio.

About the Opportunity

As the Associate Director, AP Music Theory, you are responsible for supporting the creation, sourcing, and review of musical scores, audio excerpts, and test questions for use on the AP Music Theory Exam and formative assessments. In this role, you'll collaborate closely with the AP Music Theory Course Experts who lead all operational assessment development activities. The Associate Director may also provide assessment development support in other subject areas. You will ethically and effectively integrate AI technologies in assessment development and review. This includes judiciously using AI-assisted tools to support fairness, validity, and innovation in AP assessments. You may also train subject matter experts on assessment development protocols, translate between academics and technical experts (psychometricians), and collaborate to develop formative assessment materials and resources to support AP Music Theory.

In this role, you will:

• Assessment Development and Scoring (80-90%)


• Set musical scores in Sibelius to specifications for use in AP Music Theory Exam materials. Add annotations in Adobe Illustrator and export SVGs for delivery to internal graphics team


• Edit audio to specifications using Adobe Audition and convert audio files using Adobe Media Encoder. Place audio files in digital test questions using item authoring and banking system


• Proof musical scores and audio


• Review and edit alt text for musical scores


• Source audio and musical score stimuli material for multiple-choice questions


• Compose original stimuli for multiple-choice or free-response questions


• Assist in submitting requests to use third-party stimuli to internal permissions team and in tracking permissions status for stimuli


• Support AP Music Theory Course Experts in the review process (internal and/or external) for all stimulus materials, and adapt future stimulus identification and selection process based on internal and external acceptance criteria (e.g., permissions, Development Committee review, etc.)


• Support AP Music Theory Course Experts in reviewing assessment content (formative, summative, scoring materials), recommending revisions based on established item review criteria


• Leverage generative AI to improve quality and efficiency of assessment processes and outputs.


• As needed, collaborate with AP Music Theory Course Experts to facilitate multiple face-to-face, weekend meetings, and virtual meetings (during workweek, evenings, or weekends) annually with the AP Test Development Committee


• In collaboration with AP Music Theory Course Experts, support the successful scoring of student responses for AP Exams at the annual scoring event in person and online-the "AP Reading"-and produce post-Reading publications materials for teacher and student use

Assessment Quality and Process (10-20%)

• Contribute to developing best practices in assessment and engage regularly with AP Curriculum & Assessment colleagues to align on standards and shared principles guiding AP's assessment directions


• Support assessment workstreams within the World Languages and Arts department


• Contribute to processes for efficient, high-quality assessment development


• Monitor and improve stimulus quality, reliability,