Senior Applied AI Engineer, Production Systems

Morningstar Credit Ratings, LLC; Toronto; Hybrid; CAD 102,000 - 207,000; Full time

Job summary

Morningstar Credit Ratings, LLC in Toronto is seeking a Senior Software Engineer to build applied systems that bring AI capabilities into production. You will develop data pipelines, LLM integrations, and agentic workflows to ship durable, maintainable software.

The role covers cloud and on-premise inference, evaluation design, tool interfaces, and governance to ensure reliable, deterministic outcomes. The position emphasizes applied AI engineering, strong design practices, and the ability to

Qualifications

• 5+ years of software engineering experience with production APIs and data pipelines.
• Hands-on production experience integrating LLMs: Skills, MCP, RAG, structured outputs, and tool/function calling.
• Proficient in Python across eval tooling, service-level code, and API development (FastAPI).
• Experience deploying and operating production services in AWS (or equivalent), including containerized workloads and infrastructure-as-code.
• Experience with REST/GraphQL API design and data pipelines.

Responsibilities

• Integrate with hosted LLM inference for extraction, classification, and agent orchestration workloads.
• Evaluate open-weight models against hosted options for cost and performance tradeoffs.
• Design and maintain adapters that sync source systems into a governed dataset.
• Build and maintain an eval harness to catch regressions before release.
• Design MCP tools and API/GraphQL interfaces separating fuzzy retrieval from exact governance lookups.
• Build and extend the pipeline that versions governed entities into a serving layer.
• Operate LLM-driven extraction and classification agents that propose data for human review.
• Own structured content modeling against a headless CMS with schema/versioning decisions.
• Instrument pipelines for freshness, adoption, and answer-quality telemetry.
• Participate in weekly eval review and biweekly skill-library sessions.
• Mentor engineers in applied AI work, esp. eval design and agentic-coding practices.
• Contribute governance and vocabulary decisions upstream to org-wide standards.

Skills

5+ years experience

Python

TypeScript

API design

AWS

LLMs integration

Data pipelines

Eval design

AI security

Performance tuning

Tools

FastAPI

GraphQL

Docker

IaC

Job description

Morningstar Credit Ratings, LLC in Toronto is seeking a Senior Software Engineer to build applied systems that bring AI capabilities into production. You will develop data pipelines, LLM integrations, and agentic workflows to ship durable, maintainable software.

The role covers cloud and on-premise inference, evaluation design, tool interfaces, and governance to ensure reliable, deterministic outcomes. The position emphasizes applied AI engineering, strong design practices, and the ability to