Senior Manager, Automated Scoring

TrulyHired; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

Cambium is seeking a Senior Manager of Automated Scoring to lead a multidisciplinary team developing state-of-the-art ML/NLP solutions for K-12 assessment. You will design studies, supervise data design, and publish findings to advance CAI's automated scoring, crisis detection, and feedback capabilities.

The role emphasizes remote-first collaboration with stakeholders and a strong publication track record in educational NLP applications.

Qualifications

• Ph.D. in psychometrics/measurement, NLP, or statistics or related computational field.
• 10+ years professional experience in K-12 assessment.
• 8+ years leading teams of software developers, NLP scientists, and data scientists.
• Experience with client-facing work, including presentations.
• Established publication record in NLP applications in K-12 assessment.

Responsibilities

• Lead a team of scientists on data design and analytic efforts for CAI's products.
• Present at planning and technical advisory meetings and write technical reports.
• Drive R&D agenda and set priorities for the automated scoring team.
• Design and implement studies to obtain, score, model, and examine results for CAI's NLP applications.
• Pursue applied research to publish and demonstrate CAI's leadership.
• Collaborate with stakeholders to meet needs and contribute to new products.

Skills

PhD in psychometrics/measurement, NLP,

10+ years K-12 assessment

8+ years leading teams

Client-facing presentations

Publication record in NLP in K-12

Education

PhD in psychometrics/measurement, NLP, or statistics

Job description

Senior Manager, Automated Scoring Full Description

Job Overview:

As the Senior Manager of Automated Scoring, you will play an integral part of the machine learning team, which consists of mathematicians, data scientists, psychometricians, linguists, and software engineers. Our team focuses on natural language applications in educational measurement, with key foci in the automated scoring of student responses for both summative and interim assessments, automated feedback for formative assessments, and automated alerting of disturbing content in student responses. Our team uses state-of-the-art deep learning tools and models different modalities (e.g., speech, text) and is responsible for both prototyping and deploying engines and models.

This position will lead a team of scientists on data design and analytic efforts for our suite of products, work closely with internal and external stakeholders to ensure we meet their needs, present at planning and technical advisory meetings, write technical reports and contribute to our growing body of research by publishing, and contribute to enhancements of existing products or to new products. This position will work closely with the other leads in the machine learning team on developing new applications for automated scoring methods.

Job Responsibilities

• Support CAI's innovation in natural language applications in support of our mission to improve educational outcomes for our students and educators. This includes automated scoring in large scale assessment programs (for writing, speech and other areas of educational measurement), detection of crisis alert content in student writing and the use of ML for feedback in student writing.
• Support CAI's emerging product portfolio for products that employ state of the art machine learning methods that provide solutions to real world problems in K-12, higher education and other related domains.
• Contributes to R&D agenda and sets priorities for the automated scoring team
• Drive and provide mentorship to a team of Scientists
• Design and implement studies to obtain, score, model, and examine results for any of CAI's current natural language applications, including automated scoring, crisis alert detection, and feedback.
• Pursue applied research to actively publish and represent CAI's leadership in this area
• Present at planning and technical advisory committee meetings

Job Requirements

• Ph.D. in psychometrics/measurement, NLP, or statistics or related computational field
• 10+ years professional experience in k-12 assessment
• 8+ years working with teams of software developers, NLP scientists, and data scientist
• Experience in working with client-facing work, including presentations
• Established publication record in NLP applications in k-12 assessment

To learn more about our organization and the exciting work we do, visit

Our Remote First approach gives employees the flexibility and trust they need to effectively balance work with life. It creates a culture in which all employees are valued and where success is measured in results. It allows us to work collaboratively, inclusively and for greater positive impact, regardless of our individual locations.

If you will be working remotely, either occasionally or on a permanent basis, you must have a reliable internet connection through a cable or fiber-optic broadband service with minimum speeds of 10 Mbps download and 5 Mbps upload.

The successful candidate will be expected to actively participate in video-based interviews during the recruiting process and ongoing virtual meetings with their camera on, as part of their role. To maintain confidentiality and ensure a fair evaluation process, the use of note-taking tools, reference materials, or AI-powered tools (including generative AI, language models, or similar technologies) during interviews or other selection activities is prohibited unless prior written approval has been obtained from the People Experience team. If you require an exception for medical, accessibility, or other reasons, please contact your Talent Acquisition team member to discuss accommodations in advance.

As part of our Remote-First benefits, Cambium offers reimbursement to help cover the cost of setting up your home or remote office.

An Equal Opportunity Employer

We are dedicated to fostering a culture that celebrates unique backgrounds, ideas, and experiences. All qualified applicants will receive consideration for employment without discrimination on the basis of race, color, age, religion, sex (including pregnancy, gender, gender identity/expression, or sexual orientation), national origin, protected veteran status, disability, or genetic information (including family medical history).

We will provide reasonable accommodations for qualified individuals with disabilities. You may request an accommodation during the recruiting process with your Talent Acquisition team member.