Senior Test Automation Specialist

DevRev; Poland; Remote; PLN 180,000 - 230,000; Full time

Job summary

A leading tech company in Poland is hiring a QA Automation Architect to build and scale test automation frameworks using the Playwright framework. The ideal candidate will have over 7 years of experience in quality assurance and expertise in AI-assisted testing methodologies. This role requires both strategic thinking and hands-on execution, aimed at enhancing testing efficiency and software reliability.

Qualifications

• 7+ years of experience in Quality Assurance, with 3+ years architecting automation frameworks.
• Strong problem-solving skills and attention to detail.
• Familiarity with using AI to enhance testing.

Responsibilities

• Implement AI and intelligent agents to accelerate test generation processes.
• Design and implement a test automation framework using Playwright.
• Oversee the maintenance and continuous improvement of the existing test framework.

Skills

AI-driven Test Automation

Test case design and documentation

Test Suite Development & Maintenance

Test Framework Implementation

Test reporting and analytics

Education

Bachelor’s degree in Computer Science or related field

Tools

Playwright

Docker

Kubernetes

Git

Jenkins/GitHub Actions/Azure DevOps

Job description

Overview

At DevRev, we’re building the future of work with Computer – your AI teammate.

Computer is not just another tool. It’s built on the belief that the future of work should be about genuine human connection and collaboration – not piling on more apps. Computer is the best kind of teammate: it amplifies your strengths, takes repetition and frustration out of your day, and gives you more time and energy to do your best work.

How?

Easy: it’s the only platform capable of…

Complete data unification Most AI products focus on either structured data (like CRM records and support tickets), or unstructured data (like documents and emails). Computer AirSync connects everything, unifying all your data sources (like Google Workspace, Jira, Notion) into one AI-ready source of truth: Computer Memory.

Powerful search, reasoning, and action Once connected to all your tools and apps, Computer is embedded in your full business context. It can find and summarize, sure. Even more impressive: it offers employees insights, strategic and proactive suggestions, plus powerful agentic actions.

Extensions for your teams and customers Computer doesn’t make you choose between new software and old. Its AI-native platform lets you extend existing tools with sophisticated apps and agents. So your teams – and your customers – can take action, seamlessly. These agents work alongside you: updating workflows, coordinating across teams, and syncing back to your systems.

This isn’t just software. Computer brings people back together, breaking down silos and ushering in the future of teamwork, through human-AI collaboration. Stop managing software. Stop wasting time. Start solving bigger problems, building better products, and making your customers happier.

We call this Team Intelligence. It’s why DevRev exists.

Trusted by global companies across multiple industries, DevRev is backed by Khosla Ventures and Mayfield, with $150M+ raised. We are 650+ people, across eight global offices.

Role

We are seeking a highly skilled QA Automation Architect with deep expertise in building and scaling test automation frameworks using the Playwright framework. The ideal candidate has experience defining and driving QA automation strategy across large test suites, implementing clean design principles, and introducing AI-assisted testing methodologies for smarter, more efficient QA cycles.

You will be instrumental in establishing a scalable, maintainable, and robust test automation ecosystem. This role requires both strategic thinking and hands-on execution, serving as a technical leader and mentor to the QA automation team. In this role, you will leverage AI and test automation to enhance and expedite our testing processes, govern and evolve our test frameworks, and develop a comprehensive monitoring and alerting system. Your expertise will ensure the robustness, efficiency, and reliability of our software delivery pipeline.

Key Responsibilities:

• AI-driven Test Automation:
• Implement and utilize AI and intelligent agents to accelerate test generation processes.
• Transition from manual test case development to AI-driven automation solutions, enhancing overall testing efficiency.
• Test case design and documentation:
• Define clear, concise, and comprehensive test cases based on requirements, specifications, and user stories. Ensure test cases cover both positive and negative scenarios, edge cases, and system interactions. Maintain traceability between test cases and product features.
• Test Suite Development & Maintenance:
• Organize and maintain test suites to reflect product changes and evolving test coverage needs. Refactor outdated or redundant tests, ensuring relevance and accuracy. Maintain a clear structure for manual and automated test suites for ease of access and reusability.
• Test Framework Implementation and Governance:
• Design and implement a test automation framework using Playwright for end-to-end web testing that is modular, maintainable, and scalable. Create a blueprint and best practices for the QA team to onboard and contribute new automated test cases seamlessly.
• Define coding standards, version control practices, branching strategies, and code review guidelines for the QA automation codebase.
• Integrate test automation into CI/CD pipelines with real-time test reporting.
• Explore and integrate AI-powered tools for test case generation, flakiness detection, and intelligent exploratory testing (e.g., Testim, Mabl, Diffblue, or custom LLM-based test generation tools).
  Champion shift-left testing practices by collaborating with developers, product managers, and DevOps to catch issues early.
• Oversee the maintenance and continuous improvement of the existing test framework.
• Analyze test failures and test escapes to identify root causes and implement solutions.
• Foster a culture of quality through continuous improvements in testing methodologies and frameworks.
• Test reporting and analytics:
• Design and develop test reports to provide visibility into the test suite's performance and failures.
• Implement an effective test failures alerting system to promptly notify feature owners and responsible developers of SUT issues and failures.

Qualifications:

• Minimum Bachelor’s degree in Computer Science, Engineering, or a related field.
• 7+ years of experience in Quality Assurance, with 3+ years architecting automation frameworks.
• Demonstrated experience building an automation framework from scratch, with organized test categorization, reusability, and CI/CD integration.
• Strong understanding of software testing methodologies, test planning, and test strategy.
• Familiarity with using AI to enhance testing and software development.
• Strong problem-solving skills and attention to detail.
• Experience with test reporting and analytics tools (e.g., Allure, ReportPortal, TestRail)
• Experience with test management and defect tracking systems.
• Experience with cloud-based test execution and containerization (Docker, Kubernetes).
• Familiarity with Git, Jenkins/GitHub Actions/Azure DevOps, and cloud services like AWS/GCP is a plus.
• Excellent communication, teamwork, and documentation skills, with a strong ability to advocate for best practices.

Preferred Skills:

• Hands-on experience with AI in software testing, such as using AI for test case generation, code coverage analysis, or flaky test detection.
• Knowledge of test framework design and development.
• Strong understanding of test reporting tools and technologies.

Nice to Have

• Contributions to open-source QA frameworks or tools.
• Familiarity with visual regression tools (e.g., Percy, Applitools).
• Knowledge of performance testing tools and integration with automation pipelines.
• Experience working in Agile/Scrum or DevOps-centric environments.

Join us in innovating our testing processes and ensuring the delivery of high-quality software products through advanced automation techniques.

Culture

The foundation of DevRev is its culture -- our commitment to those who are hungry, humble, honest, and who act with heart. Our vision is to help build the earth’s most customer-centric companies. Our mission is to leverage design, data engineering, and machine intelligence to empower engineers to embrace their customers.

That is DevRev!