Quality Engineer (Automation & AI) - Remote

Zyte; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Zyte seeks a Quality Engineer to join our unified Quality Engineering function. This automation-first, AI-native role sits within our engineering squads and focuses on preventing defects, accelerating delivery, and boosting confidence in every release.

You will design risk-based test strategies, convert them into automated checks with AI-assisted workflows, and build scalable automation frameworks using Playwright in GitHub CI/CD.

Qualifications

• Strong software engineering fundamentals and ability to review, validate and debug code.
• Experience with modern test automation frameworks, preferably Playwright.
• Experience using AI coding agents as a primary development partner.
• Ability to scale automation frameworks and integrate tests into CI/CD pipelines.

Responsibilities

• Design risk-based test strategies and convert them into automated coverage using AI-assisted workflows.
• Use Claude Code or equivalent AI agents as the primary development environment to create and maintain automation.
• Build and maintain automated test suites with Playwright in GitHub CI/CD pipelines.
• Design agentic testing workflows using AI models and APIs.
• Develop reusable frameworks and tools to increase test authoring velocity.
• Collaborate with engineers, product managers, and designers to shift quality left and improve observability.

Skills

Playwright

CI/CD

AI agents

Quality engineering

Test automation

Debugging

Tools

GitHub Actions

Job description

About the Role

Zyte is looking for a Quality Engineer to join our unified Quality Engineering function. This is an automation-first, AI-native role embedded directly within our engineering squads.

You will be responsible for designing risk-based test strategies, rapidly converting them into automated checks using AI-assisted development workflows, and continuously improving the quality, speed, and reliability of software delivery. Quality at Zyte is not a gatekeeping function. It is an engineering discipline focused on preventing defects, accelerating delivery, and increasing confidence in every release.

AI coding agents are a core part of how we work. You will be expected to use Claude Code or equivalent AI-assisted development environments as your primary development partner for generating, reviewing, debugging, refactoring, and maintaining automation code.

What You Will Do

• Design risk-based test strategies for new features and releases, then rapidly convert those strategies into automated coverage using AI-assisted development workflows
• Use Claude Code within VS Code or equivalent AI coding agents as your primary development environment to generate, scale, and maintain automated test coverage
• Build and maintain automated test suites using Playwright, integrated within GitHub CI/CD pipelines, ensuring quality gates are embedded throughout the software development lifecycle
• Design and implement agentic testing workflows that generate, adapt, and maintain automated tests using AI models and APIs
• Build reusable frameworks, utilities, shared libraries, and AI-powered tools that increase test authoring velocity across engineering teams
• Partner closely with engineers, product managers, and designers to shift quality left, influencing requirements, design decisions, observability, and deployment strategies
• Continuously improve test suite health by reducing flakiness, increasing execution speed, and ensuring reliable quality signals for every release
• Drive quality upstream by identifying risks early and implementing preventative quality practices
• Own and improve quality metrics including automated coverage growth, escaped defects, test execution performance, flakiness rates, and release confidence
• Enable developers to write, execute, and maintain automated tests as part of their daily workflow

What We Are Looking For

• Strong software engineering fundamentals, with the ability to review, validate and debug code across any modern programming language
• Strong experience with modern test automation frameworks, preferably Playwright
• Demonstrated ability to use AI coding agents as a primary development partner for generating, reviewing, debugging, refactoring, and maintaining code
• Comfortable delegating significant portions of implementation work to AI agents while maintaining high engineering and quality standards
• Experience building and maintaining scalable automation frameworks
• Experience integrating automated test suites into CI/CD pipelines using GitHub Actions or similar platforms
• Experience with agentic testing frameworks, AI-powered testing tools, or LLM API integrations within engineering workflows
• Proven track record of increasing automation coverage, reducing manual effort, and improving software quality outcomes
• Strong understanding of quality engineering principles, test strategy, risk analysis, and defect prevention
• Comfortable working as an embedded engineer within cross-functional product squads
• Strong communication skills with the ability to provide concise, actionable updates and collaborate effectively across teams
• Curiosity, adaptability, and a growth mindset toward emerging AI technologies and engineering practices

Nice to Have

• Experience testing AI-powered products, agents, or LLM-based applications
• Experience designing evaluation frameworks for AI-generated outputs
• Familiarity with prompt engineering, AI quality assessment, and AI observability
• Experience with performance, load, or resilience testing
• Experience with test management platforms integrated with Jira
• Experience building internal developer platforms, testing tools, or engineering productivity solutions

Success in This Role

Within your first six months, you will:

• Increase automated regression coverage for your squad
• Reduce manual testing effort sprint over sprint
• Build reusable automation components adopted by multiple teams
• Demonstrate effective use of AI agents to accelerate automation development and maintenance
• Improve release confidence while supporting fast, reliable software delivery
• Contribute to a culture where quality is owned by the entire engineering team

Originally posted on Himalayas