QA Engineer 2 - MyWP Attribution

Numerator; Indiana; On-site; USD 90,000 - 110,000; Full time

Job summary

Numerator QA Engineer role focusing on automation and manual testing to support Attribution products. You will execute and validate tests across UAT and lower environments, maintain regression suites, and drive QA with Azure DevOps, Selenium, Jira, Excel, SQL, and Power BI.

You will lead show-and-tell sessions, report defects with clear reproduction steps, and contribute to automation efforts and process improvements while embracing AI-enabled testing tools and responsible governance.

Qualifications

• Proven experience in manual and regression testing within Agile delivery environments.
• Experience using Azure DevOps and Jira for defect management and test support activities.
• Working knowledge of Selenium and ability to document test cases with accurate steps.
• Strong communication and collaboration skills across cross-functional teams.

Responsibilities

• Execute and validate tests in UAT and lower environments to identify defects early.
• Log platform defects in Azure DevOps with clear reproduction steps.
• Maintain and review regression test suites to reflect platform changes.
• Coordinate automation activities and track progress with the automation tracker.
• Lead show-and-tell sessions and communicate testing outcomes to stakeholders.
• Support final test sign-off prior to production deployment.

Tools

Azure DevOps

Jira

Selenium

Excel

SQL

Power BI

Job description

QA Test Engineer – Automation & Manual (Attribution)

Core Tech Stack: Selenium, Azure DevOps, Jira, Excel, SQL, Power BI, AI-enabled testing tools

Key Responsibilities

General

• Execute and validate existing pipeline scripts in UAT ahead of Champion testing to identify defects early, minimize downstream impact, and support smooth testing progression using Selenium.
• Communicate effectively with the Scrum team, providing clear feedback on test execution and outcomes.
• Analyze, review, and test platform features in lower environments, reporting outcomes, and supporting sign-off scenarios.
• Log platform defects in Azure DevOps with clear reproduction steps to support efficient investigation and resolution.
• Ensure test scripts are completed within agreed sprint timelines for the UAT environment.
• Provide timely updates on outstanding scripts across QC and UAT environments.
• Contribute to the continuous improvement of existing test scripts and processes.

Regression Tests

• Maintain the UAT regression test suite to reflect platform changes following implementation.
• Lead Show & Tell sessions for tested stories, highlighting risks, issues, and areas requiring attention.
• Demonstrate new functionality to business stakeholders in preparation for UAT.
• Analyze UAT test results and elevate issues in a timely manner.
• Support final test sign-off prior to promotion of features into Production.

Automation Support

• Coordinate work items for automation activity based on regression test scenarios and agreed priorities.
• Ensure that automated scripts are regularly reviewed and updated to maintain accurate coverage.
• Maintain the automated test tracker and provide accurate progress updates.

Required Skills And Experience

• Proven experience in manual and regression testing within Agile delivery environments.
• Experience using Azure DevOps and Jira for defect management and test support activities.
• Working knowledge of Selenium.
• Ability to document test cases, defects, and outcomes with a high level of accuracy and attention to detail.
• Strong communication and collaboration skills, with the ability to work effectively across cross-functional teams.

Preferred Skills And Experience

• Exposure to automated testing frameworks and scripting would be advantageous.
• Understanding UAT processes and regression testing cycles would beneficial.

Whilst AI tools are not currently a core requirement of the role, the successful candidate will be expected to demonstrate awareness of emerging AI capabilities and a willingness to support the adoption of approved tools that enhance regression testing, improve efficiency, and contribute to continuous improvement within the QA function.

Required

• Must demonstrate openness to adopting approved AI-enabled solutions within the organization’s technology landscape.
• Must be able to provide clear context, objectives, and constraints when using AI-enabled tools.
• Must possess strong analytical and problem-solving skills, with the ability to break complex testing challenges into structured tasks.
• Must be able to assess, validate, and fact-check AI-generated outputs, applying sound judgement and appropriate human oversight.
• Must demonstrate awareness of responsible AI principles, including data quality, governance, and the limitations of AI-enabled solutions.

Preferred

• Previous exposure to machine learning, generative AI, or automation concepts relevant to QA and business environments would be advantageous.
• Experience in data interpretation and basic analysis, including confidence working with structured and unstructured data, is preferred.
• An understanding of data quality standards and governance principles in support of AI-enabled use cases is desirable.
• The ability to identify automation opportunities and apply a problem-first approach to process improvement would be beneficial.

Nice to Have

• Familiarity with analytical and reporting tools such as Excel, SQL, and Power BI would be an advantage.
• Practical AI literacy, including awareness of tool limitations and the need for validation and human review, would beneficial.
• A curious, test-and-learn mindset and willingness to experiment with new approaches in a controlled environment would be valued.
• Experience of collaborating effectively across product, engineering, and business teams would be advantageous.

Performance Measures

Quality Metrics

• Test Case Execution Rate: Complete 95% of planned test cases within sprint timelines.
• Defect Reporting Accuracy: Ensure 100% of reported defects include detailed reproduction steps and screenshots.
• Regression Coverage: Maintain 100% coverage for updated UAT test suites post-implementation.

Delivery and Collaboration

• Show & Tell Participation: Conduct at least one demo per sprint for tested stories.
• Defect Resolution Turnaround: Log and communicate defects within 24 hours of identification.
• Cross-Team Engagement: Achieve full attendance in sprint ceremonies and UAT sessions.

Automation Support

• Automation Tracker Updates: Update tracker within 24 hours of any script changes.
• Automation Coverage: Ensure baseline automated coverage for critical regression scenarios (minimum 50% coverage).
• Scheduling Accuracy: Schedule automation tasks for all regression items within one business day of identification.

Continuous Improvement and Team Contribution

• Contribute to continuous improvement by proposing at least one process improvement initiative per quarter to enhance QA efficiency.
• Participate actively in knowledge-sharing activities to support team capability development and best practice adoption.