QA Power Apps

Commergence; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Commergence is seeking a detail-oriented QA Engineer to ensure the quality of Power Platform and AI-enabled solutions. You will lead test planning, automate APIs, and collaborate with developers and data scientists to validate functionality and performance.

The role requires hands-on experience with Microsoft Power Platform, Dataverse, and REST APIs, plus strong scripting and reporting skills. Join a customer-first team delivering digital transformation and e-commerce implementations.

Qualifications

• At least 3 years in QA/testing with a focus on enterprise solutions.
• 1–2 years specifically testing Microsoft Power Platform solutions.
• Hands-on testing of Power Automate workflows and data-centric apps.
• Experience with Dataverse, connectors, Azure Databricks, and Azure Storage.
• API testing (REST) with Postman; scripting validation in Python preferred.
• Performance testing using JMeter or LoadRunner; generate reports.

Responsibilities

• Define and maintain QA strategy, test plans, and coverage for Power Platform and Copilot Studio.
• Create, review, and execute test cases and scripts across SDLC phases.
• Perform functional, smoke, regression, integration, and end-to-end testing.
• Ensure traceability between requirements, tests, defects, and releases.
• Validate AI/ML outputs and data integrity; collaborate with data teams.
• Test REST services, Azure ML endpoints, and custom integrations.
• Plan and execute performance/load tests; use JMeter for reports.
• Identify, document, and track defects using Azure DevOps or Jira.
• Communicate test status, risks, and release readiness to stakeholders.

Skills

QA testing

Power Platform testing

API testing

Performance testing

AI/ML validation

Tools

Azure DevOps

Postman

Selenium (Python)

Job description

About Company

Empowering Digital Transformation | E-Commerce Implementation Experts | Customer-First Innovation At Commergence, we drive cutting‑edge digital transformation and seamless e‑commerce implementations that empower businesses to scale and thrive. With deep expertise in professional services, we go beyond solutions—craft success stories.

Job Description

We are seeking a detail‑oriented QA Engineer to test and assure the quality, performance, reliability, and compliance of solutions built using Microsoft Power Platform and Copilot Studio, including data integrations and AI/ML‑enabled features. This role will lead test planning and execution across low‑code applications, automated workflows, APIs/custom connectors, and conversational AI experiences, partnering closely with developers, data engineers/scientists, and business stakeholders.

Key Responsibilities

• Define and maintain QA strategy, test approach, and coverage for Power Platform and Copilot Studio solutions.
• Create, review, and execute test plans, test cases, and test scripts across SDLC phases.
• Perform functional, smoke, regression, integration, end‑to‑end testing.
• Ensure traceability between requirements, test cases, defects, and releases.
• Validate Dataverse/Databricks tables/entities, Power Automate flow, relationships, security roles, and data integrity rules.
• Design and execute conversation test scenarios for multi‑turn context, ambiguity handling, and error recovery.
• Perform regression testing for AI bot behaviour changes due to configuration updates, connector changes, or model/version updates.
• Perform API testing for REST services, Azure ML endpoints, and custom integrations using tools such as Postman/JMeter.
• Test data integrations and pipelines involving Azure Databricks, Azure Storage and Dataverse.
• Plan and execute performance and load tests for workflows and APIs.
• Use JMeter to simulate real‑world traffic patterns and produce performance reports.
• Identify, document, and track defects using Azure DevOps, Jira, or equivalent tools.
• Communicate test status, risks, and release readiness to stakeholders.
• Collaborate with developers, data scientists, and product owners to clarify acceptance criteria and non‑functional requirements.
• Contribute to QA best practices, reusable test assets, and automation frameworks.

Required Qualifications

• 3+ years of QA/testing experience, including 1–2 years testing Microsoft Power Platform solutions.
• Hands‑on experience testing Power Automate workflows and data‑centric applications.
• Working knowledge of Dataverse, connectors/custom connectors, Azure Databricks, and Azure Storage.
• Familiarity with Copilot Studio or chatbot testing methodologies (NLU, multi‑turn flows, fallback handling).
• Strong understanding of software testing principles (test design, execution, defect lifecycle, reporting).
• Experience with API testing (REST) using Postman and/or scripted validation (Python preferred).
• Hands‑on performance testing experience using JMeter or LoadRunner, including analysis and reporting.
• Ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behaviour.
• Basic understanding of designing prompts and edge cases to evaluate AI agent behaviour.
• Develop and maintain automation scripts for API testing, regression test suites, chat flow validation.
• Build automated validation for chatbot responses using pattern matching, similarity scoring, semantic validation (where applicable).

Preferred Qualifications

• Microsoft Certifications in Power Platform or Data Analytics/AI.
• Experience in cloud‑based testing environments (Azure preferred).
• Knowledge of accessibility, usability, and security testing.
• Exposure to CI/CD pipelines and integration of performance testing.
• Agile/Scrum project experience with Azure DevOps pipelines for Power Platform or Copilot deployments.
• Understanding of RAI principles.
• Understanding of LLM‑based systems, prompt engineering basics, RAG architecture, multi‑agent workflows.

Tools & Technologies

• Azure DevOps
• Postman
• Selenium (Python automation)

Skills

• AI tools, automation, agent testing, agentic AI