Senior Test Automation Developer

MNP; Calgary; On-site; CAD 90,000 - 130,000; Full time

Benefits offered by this job

Vacation time

4 paid personal days

Group pension plan with 4% matching

Bonus programs

Flexible benefits

Mental health resources

MNP University

Dress For Your Day environment

Job summary

MNP in Calgary, Canada, is seeking a Senior Test Automation Developer to design, build, and maintain scalable automation frameworks for UI, API, and integration testing across CI/CD pipelines. You will lead automation strategy, mentor teammates, and ensure high stability of automation suites while collaborating with DevOps, product teams, and developers.

The role covers AI-assisted testing, including evaluation of models and guardrails, and hands-on testing with Playwright or Selenium, Java or

Qualifications

• 10+ years in software testing with strong automation experience.
• Bachelor's degree in computer science, engineering or equivalent.
• Experience with AI-assisted development and testing tools preferred.
• Hands-on with LLM evaluation, AI safety concepts, and automation tools.
• Strong API testing, CI/CD integration, and test data management.

Responsibilities

• Design, develop, and maintain scalable automation frameworks for UI, API, and integration testing.
• Contribute to automation strategy and drive implementation across projects.
• Build end-to-end automation suites and integrate into CI/CD pipelines.
• Analyze failures and ensure stability of automation suites.
• Mentor team members and drive technical improvements.
• Collaborate with DevOps, product teams, and developers to ensure testability.
• Lead testing of AI-powered applications including model evaluation and guardrails.

Skills

Automation testing

Java or Python

CI/CD & DevOps

Mentoring

Debugging

Education

Bachelor's degree in CS/Engineering

Tools

Playwright

Selenium

Postman

RestAssured

Swagger

Azure DevOps

GitHub Actions

Jira

SQL Server / MySQL

Job description

Inspirational, innovative and entrepreneurial - this is how we describe our empowered teams. Combine your passion with purpose and join a culture that is thriving in the face of change.

Make an impact with our Technology - Development team as a Senior Test Automation Developer. This diverse team of tech-savvy builders and problem solvers embraces digital transformation, and the possibilities technology brings to the future of our industry. We're looking for team members who have a strong sense of ownership and drive, and who thrive on delivering high-quality solutions that are redefining the way MNP does business.

MNP is proudly Canadian. Providing business strategies and solutions, we are a leading national accounting, tax and business advisory firm in Canada. Entrepreneurial to our core, our talented team members transcend obstacles into opportunities and are successfully transforming mid-market business practices.

Responsibilities

• Design, develop, and maintain scalable, reusable automation frameworks for UI, API, and integration testing
• Contribute to automation strategy and drive implementation across assigned projects
• Build and execute end-to-end automation suites covering critical business workflows
• Integrate automation frameworks into CI/CD pipelines for continuous testing and delivery
• Analyze failures, debug issues, and ensure high stability and reliability of automation suites
• Identify gaps in automation coverage and drive improvements in test strategy and execution
• Collaborate with developers, product teams, and DevOps to ensure testability and quality from early stages (shift-left)
• Review requirements and design documents, providing technical feedback and risk assessment
• Conduct code reviews for automation scripts ensuring adherence to standards and best practices
• Mentor and support team members on automation best practices, frameworks, and tools
• Track and report automation metrics including coverage, stability, and execution results
• Ensure efficient test data management and environment configuration
• Work with Docker containers for test execution, environment setup, and CI/CD integration
• Contribute to QA standards, governance, and process improvements across teams
• Support non-functional testing (performance, scalability) where applicable
• Work in a fast-paced environment, balancing automation and hands-on QA responsibilities
• Lead the testing and evaluation of AI-powered applications by validating model performance, security controls, AI guardrails, prompt robustness, and adherence to responsible AI practices
• Collaborate with development and business teams to define test scenarios, execute test plans, and support successful deployment of UiPath and Microsoft Power Platform solutions

Skills and Experience

• 10+ years of experience in software testing, with 8+ years of strong expertise in automation
• Bachelor's degree in computer science, engineering or other equivalent combination of education and work experience
• Exposure to AI-assisted development and testing tools such as Claude, GitHub Copilot, or Codex, with familiarity in automated scripts
• Hands-on experience with LLM evaluation frameworks and tools, including assessing model performance, accuracy, relevance, and reliability
• Strong understanding of AI safety and security concepts, including guardrail evaluation, prompt injection testing, jailbreak detection, data leakage prevention, and responsible AI validation
• Strong hands-on experience with automation tools such as Playwright or Selenium
• Proficiency in programming languages such as Java or Python
• Proven experience designing and maintaining automation frameworks from scratch
• Strong understanding of test architecture, design patterns (POM, BDD), and scalable automation design principles
• Strong experience working in Agile and DevOps environments
• Experience integrating automation with CI/CD pipelines (Azure DevOps, GitHub Actions, etc.)
• Strong experience debugging and optimizing automation execution in CI/CD pipelines
• Ability to identify, document, and track defects using Azure DevOps or Jira
• Strong expertise in API testing (REST/SOAP) using Postman, RestAssured, Swagger, etc.
• Working knowledge of relational databases (SQL Server, MySQL, etc.)
• Experience ensuring traceability between requirements, test cases, and defects
• Strong analytical, debugging, and problem-solving skills
• Proven ability to mentor team members and drive technical improvements
• Excellent communication and collaboration skills across cross-functional teams

MyRewards@MNP

With a focus on high-potential earnings, MNP is proud to offer customized rewards that support our unique culture and a balanced lifestyle to thrive at work and outside of the office.

You will be rewarded with:

• generous base pay
• vacation time
• 4 paid personal days
• a group pension plan with 4% matching
• voluntary savings products
• bonus programs
• flexible benefits
• mental health resources
• exclusive access to perks and discounts
• professional development assistance
• MNP University
• a flexible 'Dress For Your Day' environment
• firm sponsored social events and more!

Diversity@MNP

We embrace diversity as a core value and celebrate our differences. We believe each team member contributes unique gifts and amplifying their potential makes our business stronger. We encourage people with disabilities to apply!