QA Engineer, AI-Driven Mortgage Apps

First National Financial; Toronto; Vor Ort; CAD 67.000 - 107.000; Vollzeit

Benefits dieser Stelle

Competitive Compensation

Comprehensive benefits program

Extensive training programs

Modern office environment

Supportive teamwork culture

Community involvement events

Ongoing social events

Zusammenfassung

First National Financial is hiring a QA Engineer for IT Applications & QA in Toronto. You will own end‑to‑end quality assurance for AI-enabled mortgage applications and workflows, developing and executing risk-based test strategies and supporting UAT and release readiness.

You will build automated regression suites, validate complex business rules, and collaborate with product, UX, and AI teams to ensure reliable, compliant software across development, QA, and production environments.

Qualifikationen

• Bachelor’s degree in computer science, engineering, information systems or a related discipline, or equivalent practical experience.
• 5+ years of progressive quality assurance, software testing, test automation, quality engineering, or related technology experience.
• Strong hands on experience testing web applications, APIs, integrations, data flows, and end to end business workflows, including functional, regression, negative, and production readiness testing.
• Practical experience with test automation and delivery tooling such as Playwright, Cypress, Selenium, Postman, Python, .NET test frameworks, SQL, Git based workflows, CI/CD, defect tracking, and test management tools.
• Experience validating complex business rules, calculations, permissions, auditability, data quality, exception handling, and operational controls in enterprise or regulated environments.
• Working knowledge of AI enabled system testing, including probabilistic outputs, RAG, document intelligence, agents, golden datasets, evaluation metrics, confidence, guardrails, drift, and human in the loop controls is strongly preferred.
• Experience supporting UAT, parallel runs, release approvals, defect triage, incident reproduction, root cause analysis, and continuous improvement with business and technology stakeholders.
• Experience in financial services, mortgage lending, lending operations, servicing, broker channels, third party partnerships, or regulated technology environments is preferred.

Aufgaben

• Define and maintain a risk based test strategy for each product increment, covering functional, integration, end to end, regression, API, data, user interface, accessibility, performance, security control, and operational readiness testing.
• Work with the Product Manager, the Residential Underwriting Business SME, the UX Designer, the AI Engineering Lead, and engineers to turn requirements, policy rules, workflows, exceptions, and acceptance criteria into traceable test scenarios and representative test data.
• Design, execute, and document manual and automated tests across web applications, APIs, services, data pipelines, document processing, permissions, audit logs, notifications, human review queues, calculations, and controlled write back to core systems.
• Build and maintain automated regression suites and CI/CD quality checks using tools such as Playwright, Cypress, Selenium, Postman, Python, .NET test frameworks, SQL, or comparable technologies, and keep tests reliable as products evolve.
• Validate deterministic rules, calculations, data transformations, interface contracts, error handling, recovery, role based access, privacy controls, and release configurations across development, QA, UAT, and production like environments.
• Partner with the AI Quality and Evaluation Lead and AI Engineers to incorporate golden datasets, AI evaluation results, guardrail tests, confidence thresholds, and known failure modes into end to end product testing, without duplicating enterprise evaluation ownership.
• Collaborate with engineers to improve system testability, observability, logging, and diagnostic capabilities.
• Coordinate defect triage, severity and priority assessment, root cause investigation, retesting, release evidence, UAT support, parallel runs, and go live readiness, and communicate quality risks clearly to product and control stakeholders.
• Use production telemetry, incidents, user feedback, monitoring signals, and escaped defects to strengthen regression coverage, improve testability, and contribute reusable test assets and quality practices across product squads.]
• CoT_job_summary_short ندارد

Kenntnisse

QA engineering

Test automation

API testing

Web testing

Regression testing

Ausbildung

Bachelor's degree in CS/Engineering or related

Tools

Playwright

Cypress

Selenium

Postman

Python

.NET test frameworks

SQL

Git

CI/CD

Jobbeschreibung

First National Financial is hiring a QA Engineer for IT Applications & QA in Toronto. You will own end‑to‑end quality assurance for AI-enabled mortgage applications and workflows, developing and executing risk-based test strategies and supporting UAT and release readiness.

You will build automated regression suites, validate complex business rules, and collaborate with product, UX, and AI teams to ensure reliable, compliant software across development, QA, and production environments.