Automation Test Engineer

Metova; United States; Remote; USD 110,000 - 160,000; Full time

Job summary

Metova is seeking a Senior Automation Test Engineer to design and implement automated testing strategies for web applications, APIs, and AI-powered solutions. You will work across CI/CD with Azure DevOps, develop tests using Playwright, Selenium, Karate, or Gatling, and contribute to QA engineering practices including BDD and performance testing.

The role emphasizes REST APIs, large language models, AI agents, and collaboration with development teams to improve quality.

Qualifications

• 4+ years of experience in QA Automation, Software Testing, or similar.
• Strong experience with API and Web Testing.
• Experience with BDD and regression testing.
• Experience with CI/CD and Azure DevOps.
• Programming experience in Java, JavaScript/TypeScript, or Python.
• Familiarity with REST APIs.
• English proficiency; written and spoken.

Responsibilities

• Design, develop, and maintain scalable test automation architectures and frameworks.
• Define and execute automated testing strategies for web applications and REST APIs.
• Develop and maintain automated regression testing strategies.
• Implement BDD practices.
• Design and execute performance testing.
• Integrate automated testing into CI/CD pipelines, particularly within Azure DevOps environments.
• Develop automated tests using Playwright, Selenium, Karate, Gatling, or similar technologies.
• Collaborate with development and engineering teams to establish quality standards throughout the software development lifecycle.
• Apply quality engineering practices to solutions incorporating Large Language Models, AI Agents, and Agentic Workflows.
• Contribute to the evaluation and validation of AI-generated outputs and AI-assisted development processes.
• Continuously improve testing processes, automation coverage, and quality practices.

Skills

QA Automation

APIs & Web Testing

BDD

Performance Testing

CI/CD

Tools

Playwright

Selenium

Karate

Gatling

Azure DevOps

Git

Job description

Senior Automation Test Engineer

We are looking for a Senior Automation Test Engineer with strong experience in test automation, API and web testing, and modern quality engineering practices. This role will be responsible for designing and implementing robust automated testing strategies across web applications, APIs, and AI-powered solutions.

The ideal candidate combines a strong foundation in QA Automation and Software Engineering with practical knowledge of Large Language Models (LLMs), AI Agents, and AI-assisted development workflows.

Key Responsibilities

• Design, develop, and maintain scalable test automation architectures and frameworks.
• Define and execute automated testing strategies for web applications and REST APIs.
• Develop and maintain effective automated regression testing strategies.
• Implement BDD (Behavior-Driven Development) practices.
• Design and execute performance testing.
• Integrate automated testing into CI/CD pipelines, particularly within Azure DevOps environments.
• Develop automated tests using Playwright, Selenium, Karate, Gatling, or similar technologies.
• Collaborate with development and engineering teams to establish quality standards throughout the software development lifecycle.
• Apply quality engineering practices to solutions incorporating Large Language Models, AI Agents, and Agentic Workflows.
• Contribute to the evaluation and validation of AI-generated outputs and AI-assisted development processes.
• Continuously improve testing processes, automation coverage, and quality practices.

Required Qualifications

• 4+ years of experience in QA Automation, Software Testing, or a similar Quality Engineering role.
• Strong experience in test automation architecture and automation strategies.
• Solid experience with API and Web Testing.
• Experience with BDD and regression testing strategies.
• Experience with Performance Testing.
• Hands-on experience with CI/CD and Azure DevOps.
• Solid experience with one or more automation technologies such as Playwright, Selenium, Karate, Gatling, or similar tools.
• Programming experience with Java, JavaScript/TypeScript, Python, or similar languages.
• Strong understanding of REST APIs.
• Experience with Git and version-control workflows.
• English proficiency: B2 level or higher.

AI & Emerging Technology Experience

• Large Language Models (LLMs).
• AI Agents and Agentic Workflows.
• Prompt Engineering and Context Engineering.
• Tool Calling and AI Orchestration.
• Specification-Driven Development.
• AI-assisted code generation.
• Evaluation and validation of AI-generated outputs.

Experience in these areas may come from professional environments, hands-on projects, or practical implementation within software development and QA workflows.