Test Analyst ( NV1 Clearance )

XPT Software; Canberra; On-site; AUD 90,000 - 130,000; Full time

Job summary

AMSA is seeking a Functional Automation Tester to deliver manual and automated testing for Microsoft Dynamics 365 and Power Platform applications. You will design and maintain automated regression tests for UI and API layers, and ensure their execution within CI/CD pipelines.

The role requires strong testing experience across web and enterprise apps, plus collaboration within an Agile team. Responsibilities include analyzing requirements, designing test scenarios, managing defects, and

Qualifications

• Experience testing Microsoft Dynamics 365 and Power Platform apps with end‑to‑end validation.

Responsibilities

• Design, develop, execute, and maintain automated regression tests (UI and API).
• Execute manual testing, validate business processes, and manage defects.
• Integrate automated tests into CI/CD pipelines (Azure DevOps).
• Collaborate in an Agile testing practice and contribute to SDLC practices.

Skills

Dynamics 365 testing

Power Platform testing

UI regression testing

API/integration testing

CI/CD integration

VS Code

Azure DevOps

Education

ISTQB Automation Certification

Tools

Playwright

Selenium

EasyRepro

Postman/Newman

REST Assured

Job description

Functional Automation Tester (character limit didn't allow this full title)

The Functional Automation Tester is responsible for delivering manual and automated testing activities to support AMSA's digital transformation initiatives. Working within AMSA's Testing Practice, the role focuses on testing Microsoft Dynamics 365 and Power Platform applications — including Power Pages, Power Apps, and Dataverse-based solutions — and their associated business processes, to ensure the quality, reliability, and usability of business solutions.

Key duties and responsibilities

The role requires the ability to quickly understand new business processes, applications, and technologies, while effectively managing testing activities across multiple concurrent projects and competing priorities. The successful candidate will be expected to become productive within a short onboarding period, work independently with minimal supervision, and contribute to a high-performing testing team.

A key aspect of the role is the design, development, execution, and maintenance of automated regression tests — spanning both UI and API/integration layers — alongside manual testing activities, and ensuring these tests run as part of AMSA's CI/CD delivery pipelines rather than purely on demand. The position requires strong UI and API testing experience and a solid working knowledge of modern testing and development tools to support the delivery of high‑quality business outcomes.

Requirements

Criteria

Essential criteria

• 1. Demonstrated experience testing Microsoft Dynamics 365 and/or Power Platform applications (Power Pages, Power Apps, Dataverse) and their associated business processes, including the ability to analyse requirements, design test scenarios, execute tests, manage defects, and support end‑to‑end business process validation.
• 2. Demonstrated experience performing UI, functional, integration, system, regression, and user acceptance testing across web‑based and enterprise applications, with a strong understanding of testing methodologies and best practices.
• 3. Strong experience in test automation and modern testing tools, covering both: * UI regression testing — design, development, execution, and maintenance of automated UI test suites for enterprise applications, particularly Dynamics 365/Power Platform, using Playwright, Selenium, EasyRepro, or similar automation frameworks; and * API/integration testing — automating validation of backend services and integrations (e.g., API Management‑fronted APIs, Dataverse plugins/custom APIs, authentication flows) using tools such as Postman/Newman, REST Assured, or Playwright's API testing capabilities.
• 4. Demonstrated experience integrating automated test suites into CI/CD pipelines (Azure DevOps), so tests execute automatically as part of build and release processes rather than solely on manual trigger.
• 5. Demonstrated proficiency with Visual Studio Code (VS Code), Azure DevOps, source control, defect management, and test management and reporting practices. Demonstrated understanding of Software Development Lifecycle (SDLC) principles and Agile delivery methodologies, including experience working collaboratively within multidisciplinary project teams.
• 6. Demonstrated adaptability and flexibility, with the ability to move between projects, technologies, testing phases, teams, and business domains as organisational priorities change.

Desirable criteria

• 1. ISTQB Automation Certification or similar certification.
• 2. Experience testing or supporting Microsoft Dynamics 365, Dataverse, Power Platform, and Power BI solutions in depth (e.g., server‑side/plugin logic, environment variable and secret configuration, API Management policy validation).
• 3. Experience using Jira or similar tools for test management and defect management, alongside Azure DevOps.