Senior AI Systems Engineer — Knowledge-Grounded & Evaluation-Driven

Pearson; Boise (ID); On-site; USD 140,000 - 160,000; Full time

Job summary

Pearson is seeking a Lead Specialist, Applied AI Systems Engineer to design, build, and improve AI systems powering the next generation of K–12 assessment tools. You will collaborate with software engineers and AI Data & Knowledge Architect to turn domain expertise into testable AI capabilities within the assessment authoring system.

The role spans predictive ML, retrieval, graph-based approaches, generative and agentic AI, and deterministic software, with emphasis on evaluating outputs against

Qualifications

• Advanced degree or equivalent experience in CS/AI/ML/statistics or related field.
• Experience designing and building complete AI or ML systems end to end.
• Breadth across predictive ML, statistical learning, LLM-based, retrieval-grounded systems.
• Experience evaluating probabilistic systems against ground truth or expert judgment.
• Knowledge graphs knowledge-grounded AI to contribute to architecture decisions.
• Strong Python, and ability to work with TypeScript.
• Autonomy with demonstrated innovation and collaboration.

Responsibilities

• Design complete, modular AI systems spanning knowledge and data inputs, retrieval, models, agents, tools, deterministic services, human review, evaluation, and integration.
• Break complex problems into predictive ML, statistical methods, generative models, retrieval, graph reasoning, deterministic software, and human decision points.
• Build working systems and reference implementations with engineers to integrate into the assessment authoring system.
• Design architectures that can evolve as models, data, domain knowledge, and evaluation evidence change.
• Design and implement agentic and knowledge-grounded workflows using models, tools, retrieval, state, outputs, and human decision points.
• Develop AI capabilities for content creation and revision, verification, alignment across frameworks, guidance, and analytic insights.
• Monitor and improve systems with evaluation benches, datasets, and performance slices.

Skills

Python

TypeScript

Data analysis

Collaboration

Autonomy

Education

Advanced degree in CS/AI/ML/Statistics

Tools

Python

TypeScript

Job description

Pearson is seeking a Lead Specialist, Applied AI Systems Engineer to design, build, and improve AI systems powering the next generation of K–12 assessment tools. You will collaborate with software engineers and AI Data & Knowledge Architect to turn domain expertise into testable AI capabilities within the assessment authoring system.

The role spans predictive ML, retrieval, graph-based approaches, generative and agentic AI, and deterministic software, with emphasis on evaluating outputs against