Senior Software Engineer- Applied AI

Morningstar Credit Ratings, LLC; Toronto; Hybrid; CAD 102,000 - 207,000; Full time

Job summary

Morningstar Credit Ratings, LLC in Toronto is seeking a Senior Software Engineer to build applied systems that bring AI capabilities into production. You will develop data pipelines, LLM integrations, and agentic workflows to ship durable, maintainable software.

The role covers cloud and on-premise inference, evaluation design, tool interfaces, and governance to ensure reliable, deterministic outcomes. The position emphasizes applied AI engineering, strong design practices, and the ability to

Qualifications

• 5+ years of software engineering experience with production APIs and data pipelines.
• Hands-on production experience integrating LLMs: Skills, MCP, RAG, structured outputs, and tool/function calling.
• Proficient in Python across eval tooling, service-level code, and API development (FastAPI).
• Experience deploying and operating production services in AWS (or equivalent), including containerized workloads and infrastructure-as-code.
• Experience with REST/GraphQL API design and data pipelines.

Responsibilities

• Integrate with hosted LLM inference for extraction, classification, and agent orchestration workloads.
• Evaluate open-weight models against hosted options for cost and performance tradeoffs.
• Design and maintain adapters that sync source systems into a governed dataset.
• Build and maintain an eval harness to catch regressions before release.
• Design MCP tools and API/GraphQL interfaces separating fuzzy retrieval from exact governance lookups.
• Build and extend the pipeline that versions governed entities into a serving layer.
• Operate LLM-driven extraction and classification agents that propose data for human review.
• Own structured content modeling against a headless CMS with schema/versioning decisions.
• Instrument pipelines for freshness, adoption, and answer-quality telemetry.
• Participate in weekly eval review and biweekly skill-library sessions.
• Mentor engineers in applied AI work, esp. eval design and agentic-coding practices.
• Contribute governance and vocabulary decisions upstream to org-wide standards.

Skills

5+ years experience

Python

TypeScript

API design

AWS

LLMs integration

Data pipelines

Eval design

AI security

Performance tuning

Tools

FastAPI

GraphQL

Docker

IaC

Job description

Job Description About Morningstar

Morningstar unites problem solvers with a clear goal: helping investors achieve their financial objectives. As a leading investment research and data company, we stand out by how we apply our insights to serve a broad range of users. Our independent investment research, powered by cutting-edge technology and design, provides tailored solutions that meet users' needs. With a strong foundation in data and innovation, we deliver comprehensive services to investors worldwide, empowering better decisions for individuals and those managing money for millions.

The Role

We are seeking a Senior Software Engineer to build the applied systems that bring AI capabilities into production: the data pipelines, LLM integrations, agentic workflows, tool interfaces, and evaluation frameworks that make AI-driven products reliable enough to depend on. This is applied engineering rather than research; success is measured in shipped, maintainable systems. You may be a strong fit if you love working within a landscape that changes quickly, creating durable architectures with swappable parts, so new models and techniques are adopted on evidence. The role encompasses fluency across cloud architecture and local model inference, evaluation design, agentic workflows and orchestration, API and tool design, and AI-assisted data enrichment. It also requires the engineering rigor to establish reliable sources of truth, detect regressions, and recognize when a deterministic solution is more appropriate than an AI-driven one.

Morningstar's hybrid work environment gives you the opportunity to collaborate in-person each week as we've found that we're at our best when we're purposely together on a regular basis. In most of our locations, our hybrid work model is four days in-office each week. A range of other benefits are also available to enhance flexibility as needs change. No matter where you are, you'll have tools and resources to engage meaningfully with your global colleagues. This position is based in our Toronto office. We follow a hybrid policy of at least 4 days onsite.

Job Responsibilities

• Integrate with hosted LLM inference (via centralized model gateway infrastructure) for extraction, classification, and agent orchestration workloads
• Evaluate open-weight models against hosted options for cost and performance tradeoffs
• Design and maintain adapters that sync source systems (CMS, event platforms, editorial, research libraries) into a governed dataset without duplicating source-of-record logic
• Build and maintain an eval harness: curate golden questions, catch regressions before release, and treat eval results as the gate for shipping
• Design MCP tools and API/GraphQL interfaces that separate "fuzzy" retrieval (ranked candidates, confidence scores) from "exact" governed lookups (deterministic, provenance-carrying)
• Build and extend the pipeline that validates, resolves, and versions governed entities into a serving layer
• Design and operate LLM-driven extraction and classification agents that propose structured data for human review rather than auto-publishing unreviewed AI output
• Own structured content modeling against a headless CMS, including schema and versioning decisions that other teams depend on
• Instrument pipelines and served surfaces for freshness, adoption, and answer-quality telemetry
• Participate in and help run the weekly eval review and the biweekly skill-library session, harvesting reusable agent tooling for the team
• Mentor engineers being reskilled into applied AI work, particularly around eval design and agentic-coding practices
• Contribute governance and vocabulary decisions upstream to org-wide standards where relevant, rather than duplicating them

Qualifications

• 5+ years of software engineering experience, including production API and data-pipeline design
• Comfort working with agentic coding tools daily as a core part of the workflow
• Hands-on production experience integrating LLMs: Skills, MCP, RAG, structured outputs, and tool/function calling
• Strong proficiency in Python across eval tooling, service-level code, and API development (FastAPI or similar), plus working proficiency in TypeScript/Node.js for application integrations
• Experience deploying and operating production services in AWS (or equivalent), including containerized workloads and infrastructure-as-code
• Security and privacy judgment in AI systems: handling sensitive data appropriately, and designing against failure modes like prompt injection, data leakage through prompts, and unsafe or unattributed model output
• Experience operating production systems against latency, reliability, and cost targets, including token-cost management for inference workloads
• Evaluation literacy: you can describe an eval you built, what it caught, and how you handled canonical truth, variance, and regression cases
• Experience with REST/GraphQL API design
• Solid understanding of data pipeline patterns: idempotency, versioning, and staged architectures
• Explicitly not required: formal model training or ML research credentials (e.g., pretraining, fine-tuning research). This is an applied systems role; we're looking for builders, not researchers
• Strong written communication. You can write a clear design doc, explain a tradeoff to a non-engineer, and document decisions others will build against
• Creative problem solver comfortable operating in ambiguity, with a builder's bias toward shipping over ceremony

Nice to have

• Experience evaluating or benchmarking open-weight models for cost/performance (inference-time evaluation, not training)
• Experience with cloud-hosted inference services (e.g., Amazon Bedrock, Azure AI/Cognitive Services) and centralized LLM gateways (e.g., LiteLLM)
• Experience with headless CMS platforms and structured content modeling
• Experience in a regulated or compliance-sensitive domain where provenance and auditability matter

Total Cash Compensation (Base Plus Bonus Target)

101,800.00 - 207,000.00 CAD

If you receive and accept an offer from us, we require that personal and any related investments be disclosed confidentiality to our Compliance team (days vary by region). These investments will be reviewed to ensure they meet Code of Ethics requirements. If any conflicts of interest are identified, then you will be required to liquidate those holdings immediately. In addition, dependent on your department and location of work certain employee accounts must be held with an approved broker (for example all, U.S. employee accounts). If this applies and your account(s) are not with an approved broker, you will be required to move your holdings to an approved broker.

Morningstar's hybrid work environment gives you the opportunity to collaborate in-person each week as we've found that we're at our best when we're purposely together on a regular basis. In most of our locations, our hybrid work model is four days in-office each week. A range of other benefits are also available to enhance flexibility as needs change. No matter where you are, you'll have tools and resources to engage meaningfully with your global colleagues.

Morningstar is a global independent investment research and financial data company. Here, you'll help uncover what's hidden, simplify what's complex, and create insights that empower investor success.

Company overview Morningstar Development Program Morningstar is strongly committed to creating and preserving equal opportunity for all employees and applicants. We make all employment decisions - recruitment, hiring, compensation, training, promotion, transfer, discipline, termination, and other personnel matters - without regard to race, color, ancestry, religion, sex, national origin, age, disability, protected veteran status, marital status, sexual orientation, genetic information, citizenship, gender identity and expression, parental status, or other legally protected characteristics or conduct.