QA Automation Engineer

alvys

United States

Remote

USD 120,000 - 160,000

Full time

21 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote work

Job summary

alvys is seeking a Quality Engineering role focused on building a robust automation and testing foundation for a product area. You will design Playwright-based frameworks, own CI/CD test pipelines, and establish risk-based testing strategies that include AI-assisted testing and post-release monitoring.

The ideal candidate has 4–7 years in software/testing, a BS in CS/Engineering, and hands-on experience with Playwright frameworks and CI/CD quality controls.

Qualifications

  • 4-7 years of software or test engineering experience.
  • Bachelor's degree in computer science, engineering, or related field.
  • Ability to design Playwright automation frameworks adopted by other engineers.
  • Experience owning CI/CD quality pipelines, including parallelization and post-release monitoring.
  • Practical AI skills: write specs with acceptance checks and evaluate agent output.

Responsibilities

  • Design reusable Playwright-based automation frameworks and quality infrastructure.
  • Own the CI/CD test pipeline, including parallel execution and post-deployment monitoring.
  • Define test strategy, coverage goals, risk-based priorities, and test data practices.
  • Apply contract, performance, synthetic, or resilience testing where risks warrant it.
  • Develop AI-assisted testing workflows and evaluation methods for variable outputs.
  • Improve release gates and address systemic issues with cross-team collaboration.

Skills

Playwright
Automation frameworks
CI/CD quality pipelines
AI evaluation
Analytical thinking

Education

Bachelor's degree in CS/Engineering

Tools

Playwright
CI/CD tooling

Job description

Role overview

Build the quality engineering foundation for a product area, enabling engineering teams to deliver reliable software with confidence. The role combines test architecture, automation frameworks, CI/CD quality controls, and post-release monitoring, while also applying structured evaluation and safeguards to AI-assisted testing and AI-powered features.

Responsibilities
  • Design reusable Playwright-based automation frameworks and quality infrastructure that engineers across teams can use.
  • Own the CI/CD test pipeline, including parallel execution, test stability targets, artifact collection, and post-deployment monitoring.
  • Define test strategy, coverage goals, risk-based priorities, test data practices, and isolated environments for dependable results.
  • Apply contract, performance, synthetic, or resilience testing where product risks warrant it; track test health and detection metrics.
  • Develop controlled AI-assisted testing workflows and evaluation and regression methods for features with variable outputs.
  • Improve release gates, lead quality reviews after incidents, and work with product, platform, and customer teams to address systemic issues.
Requirements
  • 4-7 years of software or test engineering experience and a bachelor's degree in computer science, engineering, or a related field.
  • Demonstrated ability to design Playwright automation frameworks adopted by other engineers.
  • Experience owning CI/CD quality pipelines, including parallelization, flaky-test management, and post-release monitoring.
  • Ability to set a test strategy for complex systems using risk priorities and measurable quality indicators.
  • Practical AI skills: write specifications with acceptance checks, evaluate agent output against evidence, and track work outside an agent's context.
  • Strong analytical and problem-solving skills.
Nice to have
  • Experience with agent-based testing harnesses, CI evaluation suites, and reusable checks based on prior failures.
  • Background in AI evaluation, contract testing, synthetic monitoring, chaos engineering, or performance and load testing.
  • Experience mentoring test engineers or improving quality practices across teams; familiarity with common issue-tracking or test-management tools.
Benefits and work setup
  • The listing describes the position as remote.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

QA Automation Engineer (Fully Remote)
QA Automation Engineer (Fully Remote)

Applaudo • United States

Remote
USD 90,000 - 130,000
Automation & Quality Engineer — AI-Driven Testing
Automation & Quality Engineer — AI-Driven Testing

Subway Group • Shelton (CT)

Hybrid
USD 90,000 - 120,000
QA Automation Engineer
QA Automation Engineer

Chatoly Assistant • United States

Remote
USD 90,000 - 130,000
QA Engineer, Agentic Development
QA Engineer, Agentic Development

clariticloudinc • United States

Remote
USD 75,000 - 90,000
QA Automation Engineer with TypeScript and Playwright, AI Platform
QA Automation Engineer with TypeScript and Playwright, AI Platform

DataArt • United States

Remote
USD 90,000 - 130,000
QA Automation Engineer
QA Automation Engineer

Productiv Teams • United States

Remote
USD 70,000 - 110,000
QA Automation Engineer – Playwright & AI
QA Automation Engineer – Playwright & AI

American IT Systems • San Jose (CA)

On-site
USD 140,000 - 190,000
Member of Technical Staff, Quality Engineering
Member of Technical Staff, Quality Engineering

Micro1 • United States

Remote
USD 120,000 - 190,000
QA Test Analyst - AI & Test Automation
QA Test Analyst - AI & Test Automation

Volantsoft Inc • United States

Remote
USD 85,000 - 115,000
Senior QA Automation Engineer (fixed-term)
Senior QA Automation Engineer (fixed-term)

valtech • United States

Remote
USD 120,000 - 150,000
Workplace refreshments
Social events
Challenging project work
+2