QA Automation Engineer - AI-Driven Playwright (Shopify)

Allure Commerce; United States; Remote; USD 110,000 - 150,000; Full time

Job summary

Allure Commerce is seeking a Senior QA Automation Engineer to own testing for Shopify-based apps. You will design test plans, write automation with Playwright in JavaScript/TypeScript, and drive quality across web experiences.

You will collaborate with developers and product teams, leverage AI tools to enhance test coverage, participate in sprint planning, and help maintain scalable QA frameworks across distributed teams.

Qualifications

• 35 years of experience in Software Quality Assurance.
• Minimum 2-3 years of hands-on experience testing Shopify-based applications.
• Strong hands-on experience in Automation Testing.
• Proficiency in Playwright using JavaScript/TypeScript.
• Experience designing, developing, and maintaining automation frameworks.
• Strong understanding of web application testing, API testing, cross-browser testing, and responsive testing.
• Hands-on experience using AI-powered testing tools and Large Language Models (LLMs) to improve QA productivity.
• Ability to design, build, and deploy AI Agents that automate QA workflows such as test generation, execution, bug analysis, reporting, and validation.
• Familiarity with AI frameworks and agent orchestration platforms (such as OpenAI APIs, LangChain, LangGraph, CrewAI, AutoGen, or similar) is highly preferred.
• Good understanding of CI/CD pipelines and automation integration.
• Experience with defect tracking and test management tools.
• Strong analytical and problem-solving skills with excellent attention to detail.
• Excellent verbal and written communication skills.
• Ability to work independently in a remote environment while managing multiple priorities.
• Passion for continuous learning and staying updated with emerging technologies in QA, automation, and AI.

Responsibilities

• Create detailed, comprehensive, and well-structured test plans, test cases, and testing strategies.
• Analyze business and technical requirements to design and execute effective test scenarios.
• Perform functional, regression, integration, system, API, and end-to-end testing.
• Develop and maintain automated test scripts using Playwright.
• Build, enhance, and maintain scalable automation frameworks to improve test coverage and execution efficiency.
• Leverage AI tools and AI agents to automate QA activities such as test case generation, regression testing, defect analysis, reporting, and workflow optimization.
• Identify opportunities to integrate AI-driven testing solutions into the QA lifecycle to improve productivity and reduce manual effort.
• Estimate testing effort and provide accurate timelines for testing activities.
• Identify, document, prioritize, and track defects using standard defect management tools.
• Collaborate closely with developers, product managers, and stakeholders to resolve issues and ensure product quality.
• Participate in sprint planning, requirement analysis, and release validation activities.
• Maintain testing standards, best practices, and documentation.
• Prepare daily status reports and update progress on company-approved project management and testing tools.
• Ensure timely delivery of testing activities while maintaining high-quality standards.
• Continuously research and adopt emerging QA methodologies, automation practices, and AI advancements.
• Work effectively with distributed teams and clients across different time zones.
• Demonstrate strong working knowledge of the Shopify ecosystem and eCommerce workflows.

Skills

Automation Testing

Playwright (JS/TS)

CI/CD pipelines

AI in QA

API testing

Cross-browser testing

Debugging

Remote collaboration

Tools

Playwright

Job description

Allure Commerce is seeking a Senior QA Automation Engineer to own testing for Shopify-based apps. You will design test plans, write automation with Playwright in JavaScript/TypeScript, and drive quality across web experiences.

You will collaborate with developers and product teams, leverage AI tools to enhance test coverage, participate in sprint planning, and help maintain scalable QA frameworks across distributed teams.