Senior Applied AI Systems Engineer - Education & Assessment

Pearson; Cheyenne (WY); Vor Ort; USD 140.000 - 160.000; Vollzeit

Zusammenfassung

Pearson seeks a Lead Specialist, Applied AI Systems Engineer to design and implement end-to-end AI systems for next-generation K–12 assessment and learning. You will work across knowledge graphs, retrieval, and agentic AI while collaborating with content, psychometrics, and software teams to ensure robust evaluation and reliable results.

The role emphasizes autonomous prototyping, transparent reasoning, and responsible AI practices, with Pearson's commitment to impactful, evidence-based

Qualifikationen

• Advanced degree in CS, AI, ML, Statistics or related field.
• Experience designing and building complete AI/machine-learning systems end to end.
• Strong breadth across predictive ML, statistical learning, LLM-based and retrieval-grounded systems.
• Demonstrated experience evaluating probabilistic systems against ground truth or expert judgment.
• Experience with knowledge graphs and knowledge-grounded AI.
• Strong Python proficiency; experience with TypeScript or ability to work in TS.

Aufgaben

• Design complete, modular AI systems spanning knowledge and data inputs, retrieval, models, agents, tools, deterministic services, human review, evaluation, and integration.
• Break complex problems into the right mix of predictive ML, statistical methods, generative models, retrieval, graph reasoning, deterministic software, and human decision points.
• Build working systems and reference implementations, and partner with software engineers to bring them into the assessment authoring system.
• Design architectures that can evolve as models, data, domain knowledge, and evaluation evidence change.
• Design and implement agentic and multi-step workflows using models, tools, retrieval, state, outputs, and human decision points.
• Build knowledge-grounded systems using graph, semantic, vector, and hybrid retrieval; co-design knowledge/graph architecture with AI Data & Knowledge Architect.
• Develop AI capabilities for content creation, revision, verification, alignment, guidance, and analytic insights.
• Make evaluation integral to development; maintain evaluation benches with expert-adjudicated datasets, challenge sets, and holdout data.
• Partner with psychometricians and content experts to turn domain expectations into measurable criteria.
• Analyze failure modes, performance across data slices, and monitor system drift to drive improvements.
• Develop predictive models, classifiers, and ranking methods where they outperform generative AI.
• Evaluate tradeoffs among prompting, retrieval, structured knowledge, model selection, and adaptation.

Kenntnisse

End-to-end AI systems

Python

TypeScript

Knowledge graphs

Ground-truth evaluation

Collaboration

Innovation & autonomy

Ausbildung

Advanced degree in CS/AI/ML/Statistics

Tools

TypeScript

Jobbeschreibung

Pearson seeks a Lead Specialist, Applied AI Systems Engineer to design and implement end-to-end AI systems for next-generation K–12 assessment and learning. You will work across knowledge graphs, retrieval, and agentic AI while collaborating with content, psychometrics, and software teams to ensure robust evaluation and reliable results.

The role emphasizes autonomous prototyping, transparent reasoning, and responsible AI practices, with Pearson's commitment to impactful, evidence-based