Director, AI-Powered Assessment Solutions (Remote)

collegeboard

United States

Remote

USD 180,000 - 250,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work options

Job summary

College Board is seeking a Director, Applied AI Assessment Solutions to drive AI-enabled item development across the SAT Suite and related programs. You will lead the design, tooling, prompts, and workflows, delivering scalable solutions while ensuring quality and ethical AI use in assessment creation and review.

This fully remote, full-time role emphasizes collaboration with content teams, technology, and product stakeholders to maximize ROI and minimize duplicative work across the enterprise.

Responsibilities

  • Lead end-to-end delivery for College Board assessment program engagements: define the problem, design/build AI tools, prompts, and workflows, and deliver a working solution with a training/adoption plan.
  • Apply expert judgment to evaluate AI outputs against standards, catch misalignment, bias, and errors, and refine prompts and workflows.
  • Establish quality standards and evaluation criteria for AI-generated content, translating expertise into rubrics or scoring frameworks.
  • Identify and articulate requirements for systems-based solutions needing input from stakeholders and shape roadmaps for AI-enabled item development.
  • Diagnose gaps, document conditions for scaling enablement, and influence program roadmaps and enterprise tooling.
  • Represent program needs in cross-program discussions about shared tooling and methodology, contributing to enterprise-wide strategy.

Job description

College Board is seeking a Director, Applied AI Assessment Solutions to drive AI-enabled item development across the SAT Suite and related programs. You will lead the design, tooling, prompts, and workflows, delivering scalable solutions while ensuring quality and ethical AI use in assessment creation and review.

This fully remote, full-time role emphasizes collaboration with content teams, technology, and product stakeholders to maximize ROI and minimize duplicative work across the enterprise.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Director, AI Assisted Solutions-1
Director, AI Assisted Solutions-1

collegeboard • United States

Remote
USD 180,000 - 250,000
Remote work options
Assessment Delivery Specialist
Assessment Delivery Specialist

Motion Recruitment • United States

Remote
USD 56,000 - 89,000
K-12 Delivery Lead, Remote — AI Training & Assessments
K-12 Delivery Lead, Remote — AI Training & Assessments

Sun Technologies, Inc. • Reston (VA)

Hybrid
USD 69,000 - 76,000
Medical Insurance under ACA
401(k)
Sick leave
Remote Content Developer—AI-Enhanced Assessments
Remote Content Developer—AI-Enhanced Assessments

Pearson • Phoenix (AZ)

Remote
USD 70,000 - 80,000
Senior AI Systems Engineer for Educational Assessment
Senior AI Systems Engineer for Educational Assessment

Pearson • Augusta (ME)

On-site
USD 140,000 - 160,000
Senior AI Systems Engineer, Education & Assessment
Senior AI Systems Engineer, Education & Assessment

Pearson • Atlanta (GA)

On-site
USD 140,000 - 160,000
Remote Managing Director, AI-Enabled Assessment & Workforce
Remote Managing Director, AI-Enabled Assessment & Workforce

americaninstitutesforresearch • United States

Remote
USD 210,000 - 320,000
Senior AI Systems Engineer, Education & Assessment
Senior AI Systems Engineer, Education & Assessment

Pearson • Lansing (MI)

On-site
USD 140,000 - 160,000
Senior AI Systems Engineer - Education & Assessment
Senior AI Systems Engineer - Education & Assessment

Pearson • Oklahoma City (OK)

On-site
USD 140,000 - 160,000
Senior AI Systems Engineer - Education & Assessment
Senior AI Systems Engineer - Education & Assessment

Pearson • Madison (WI)

On-site
USD 140,000 - 160,000
Annual incentive program
Equal Opportunity Employer