Test Automation Engineer

Papigen; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

Papigen is seeking a Test Automation Engineer in the United States to build and maintain shared automation frameworks for UI, API, E2E, and regression testing. You will leverage AI tools to generate tests, validate AI-generated code, and integrate automation into CI/CD pipelines to ensure reliable software delivery.

The ideal candidate has 5+ years of hands-on automation experience, strong UI/API/E2E testing skills, and hands-on AI-assisted delivery experience.

Qualifications

• 5+ years of hands-on test automation experience.
• Strong experience building and maintaining automated test suites.
• Practical UI, API, E2E, and regression testing experience.
• Experience with Playwright or Selenium.

Responsibilities

• Build and maintain reusable UI, API, E2E, and regression automation suites.
• Develop automation frameworks using Playwright, Selenium, TypeScript, or Python.
• Use AI tools to generate test scripts and assertions, then review and correct output.
• Integrate automated tests into CI/CD pipelines using Azure DevOps or GitHub Actions.
• Manage test data, environment dependencies, and test execution.
• Investigate failures, flaky tests, incorrect locators, synchronization issues, and assertion problems.
• Test AI features by checking output accuracy, grounding, and consistency against source information.
• Maintain readable, reusable, reliable, and maintainable automation code.
• Track test coverage, regression execution time, failures, and automation effectiveness.

Skills

typescript

e2e

automation

playwright

artificial intelligence

Tools

Playwright

Selenium

Postman/Newman

Azure DevOps

GitHub Actions

Job description

Role Overview

The Test Automation Engineer will build and maintain shared automated testing frameworks and suites covering UI, API, end-to-end (E2E), and regression testing. The role involves using AI tools to generate and improve tests, validating AI-generated code, integrating automation into CI/CD pipelines, and testing AI-powered features against reliable source data.

Role Overview

The Test Automation Engineer will build and maintain shared automated testing frameworks and suites covering UI, API, end-to-end (E2E), and regression testing. The role involves using AI tools to generate and improve tests, validating AI-generated code, integrating automation into CI/CD pipelines, and testing AI-powered features against reliable source data. The ideal candidate has strong hands-on automation experience and at least 1 year of AI-assisted delivery experience.

Key Responsibilities

• Build and maintain reusable UI, API, E2E, and regression automation suites.
• Develop automation frameworks using Playwright, Selenium, TypeScript, or Python.
• Use AI tools to generate test scripts and assertions, then review and correct the output.
• Integrate automated tests into CI/CD pipelines using Azure DevOps or GitHub Actions.
• Manage test data, environment dependencies, and test execution.
• Investigate failures, flaky tests, incorrect locators, synchronization issues, and assertion problems.
• Test AI features by checking output accuracy, grounding, and consistency against source information.
• Maintain readable, reusable, reliable, and maintainable automation code.
• Track test coverage, regression execution time, failures, and automation effectiveness.

Mandatory Skills & Experience

• 5+ years of hands-on test automation experience.
• Strong experience building and maintaining automated test suites.
• Practical UI, API, E2E, and regression testing experience.
• Experience with Playwright or Selenium.
• Programming skills in TypeScript or Python.
• Experience with API testing tools such as Postman/Newman or equivalent.
• At least 1 year of hands-on AI-assisted delivery for test generation, automation development, or test maintenance.
• Ability to review AI-generated tests for correct locators, assertions, waits, reliability, and maintainability.
• Experience integrating automation into CI/CD pipelines.
• Ability to investigate test failures and distinguish genuine product defects from automation issues.
• Understanding that a passing automated test does not, by itself, prove product quality.

Preferred Skills

• Playwright with TypeScript.
• Azure DevOps pipelines or GitHub Actions.
• Codex, Augment Code, Claude, or GitHub Copilot.
• Experience testing GenAI or document-AI features.
• Validation of AI output against source documents or expected ground-truth results.
• Experience building shared automation frameworks adopted by multiple teams.

Skills: typescript,e2e,automation,playwright,artificial intelligence