QA Engineer – Power Platform & AI

Floating Dots; United States; Remote; USD 70,000 - 110,000; Full time

Job summary

Floating Dots SRL is seeking two QA Engineers for a six-month project to assure the quality of AI-enabled IT Service Management solutions built on Microsoft Power Platform and Copilot Studio. You will collaborate with Product Owners and developers on test planning, manual and automated testing, and release sign-off readiness.

Responsibilities include reviewing stories, designing test plans, and building regression suites for Power Apps, Power Automate, and Dataverse, plus validating Copilot

Qualifications

• 3–6 years of QA experience, including 1–2 years on Power Platform solutions.
• Familiarity with Copilot Studio and testing conversational or GenAI solutions.
• Solid understanding of ITSM processes and platforms (e.g., ServiceNow, Jira Service Management).
• Test automation experience with Power Apps Test Engine, Playwright, Selenium or Postman.
• Experience with Agile / Scrum and Jira-based defect and test management.
• Strong written and verbal English communication.

Responsibilities

• Review user stories and acceptance criteria with Product Owners, identifying gaps and testability risks.
• Design and run test plans, test cases and regression suites for Power Apps, Power Automate, and Dataverse components.
• Test Copilot Studio agents: conversations, intents, accuracy, and safeguards.
• Validate end-to-end ITSM scenarios including incidents, requests, changes, and knowledge.
• Build and maintain automated tests (regression, API, UI) as the solution matures.
• Log, triage and track defects in Jira, verify fixes and report quality metrics.
• Support UAT with test data and consolidated feedback.
• Contribute to release readiness with test summaries and go/no-go input.

Skills

QA experience (3-6 yrs)

Power Platform

Copilot Studio testing

ITSM knowledge

Test automation

Agile / Scrum

Jira

English communication

Education

ITIL v4 Foundation

ISTQB Certification

Microsoft Certifications (PL-900/PL-200/AI-900)

Tools

Power Apps Test Engine

Playwright

Selenium

Postman

Jira

Job description

For one of our clients, we are looking for 2 QA Engineers for a 6-month project, to ensure the quality of AI-enabled IT Service Management (ITSM) solutions built on Microsoft Power Platform and Copilot Studio. You will work closely with Product Owners and developers, covering test planning, manual and automated testing and release sign-off readiness.

Key Responsibilities

• Review user stories and acceptance criteria with Product Owners, identifying gaps and testability risks early.

• Design and run test plans, test cases and regression suites for Power Apps, Power Automate flows and Dataverse components.

• Test Copilot Studio agents: conversation flows, intent handling, accuracy of answers, fallback behaviour and responsible AI safeguards.

• Validate end-to-end ITSM scenarios (incidents, requests, changes, knowledge), including integrations and notifications.

• Build and maintain automated tests (regression, API and UI) as the solution matures.

• Log, triage and track defects in Jira, verify fixes and report quality metrics.

• Support UAT by preparing test data, guiding business testers and consolidating feedback.

• Contribute to release readiness with test summary reports, go/no-go input and post-release validation.

Requirements

• 3–6 years of QA experience, including at least 1–2 years on Power Platform solutions (Power Apps, Power Automate, Dataverse).

• Familiarity with Copilot Studio and testing conversational or GenAI solutions.

• Solid understanding of ITSM processes and platforms (ServiceNow, Jira Service Management or similar).

• Test automation experience with tools such as Power Apps Test Engine, Playwright, Selenium or Postman (API testing).

• Experience with Agile / Scrum and Jira-based defect and test management.

• Strong analytical skills and clear written and verbal communication in English.

Nice to Have

• ITIL v4 Foundation or higher; ISTQB; Microsoft certifications (PL-900, PL-200, AI-900).

• CI/CD pipelines (Azure DevOps or GitHub Actions) and Power Platform ALM.

• Knowledge of LLM evaluation approaches (test datasets, response quality scoring, hallucination checks).

• Basic scripting skills (Python, JavaScript or PowerShell).