Senior AI Systems Engineer - Education & Assessment

Pearson; Madison (WI); Vor Ort; USD 140.000 - 160.000; Vollzeit

Benefits dieser Stelle

Annual incentive program

Equal Opportunity Employer

Zusammenfassung

Pearson is seeking a Lead Specialist, Applied AI Systems Engineer to design, build, and enhance intelligent AI systems for next‑gen K–12 assessment and learning. You will work at the intersection of Content Development, Learning Science, Technology, and Psychometrics to translate expertise into testable AI capabilities within the Pearson assessment authoring system.

The role emphasizes end‑to‑end system design, agentic workflows, and rigorous evaluation against ground truth and expert judgment,

Qualifikationen

• Advanced degree in CS, AI, ML, Statistics, or related field, or equivalent experience.
• Experience designing and building end-to-end AI/ML systems beyond standalone models.
• Breadth across predictive ML, statistical learning, LLM-based, retrieval-grounded systems.
• Experience evaluating probabilistic systems against ground truth or expert judgment.
• Experience with knowledge graphs and knowledge-grounded AI architectures.
• Strong Python proficiency and experience with TypeScript or quickly learning a TS codebase.
• Proven autonomy and high technical judgment with collaboration.
• Ability to translate domain expertise into evaluation criteria and requirements.

Aufgaben

• Design complete, modular AI systems spanning data inputs, retrieval, models, agents, tools, and human review.
• Develop agentic workflows using models, tools, retrieval, state, and structured outputs.
• Build evaluation benches with expert datasets and protected holdout data; monitor for drift.
• Collaborate with engineers, content experts, psychometricians to align with frameworks and evaluation criteria.

Kenntnisse

AI/ML system design

Probabilistic evaluation

Graph knowledge-grounded AI

Python

TypeScript

Autonomy & judgment

Requirement derivation

Ausbildung

Advanced degree in CS/AI/ML/Stats or related field

Equivalent experience

Tools

Go

MLflow

Jobbeschreibung

Pearson is seeking a Lead Specialist, Applied AI Systems Engineer to design, build, and enhance intelligent AI systems for next‑gen K–12 assessment and learning. You will work at the intersection of Content Development, Learning Science, Technology, and Psychometrics to translate expertise into testable AI capabilities within the Pearson assessment authoring system.

The role emphasizes end‑to‑end system design, agentic workflows, and rigorous evaluation against ground truth and expert judgment,