Senior QA Automation Engineer for AI-Enabled Testing

Advanced Tech Placement; Alpharetta (GA); On-site; USD 120,000 - 160,000; Full time

Job summary

Advanced Tech Placement in Alpharetta/Georgia seeks a hands-on Senior QA Automation Engineer with expertise in traditional testing and AI/LLM-powered applications. Design and execute manual and automated tests for UI and API, build robust automation frameworks, and contribute to CI/CD integration.

You will work with Engineering, Product, and QA teams to improve test coverage, reliability, and efficiency, leveraging Python/JS/TS, pytest, Playwright/Cypress/Selenium, and advanced QA practices.

Qualifications

• Hands-on QA testing—manual and automated; strong API/UI testing experience.
• Proficient in Python, JavaScript or TypeScript; comfort with test automation.
• Experience with modern QA tools: pytest, Playwright, Cypress, Selenium.
• Experience testing AI/LLM-powered applications and agentic workflows.
• Ability to design tests for multi-turn conversations and non-deterministic AI outputs.
• Familiar with LLm evaluation frameworks and regression testing.
• Knowledge of BDD, TDD, ATDD and Agile methodologies; CI/CD familiarity.
• Experience with SQL/NoSQL databases and QA tooling like Jira.

Responsibilities

• Design and execute manual and automated tests for UI, API, integration, end-to-end, and regression testing.
• Test AI agents, multi-turn conversations, LLM outputs, and agentic workflows.
• Build evaluation frameworks and regression suites to measure LLM quality and reliability.
• Automate API and UI testing using Python, JS/TS, pytest, Playwright, Cypress, or Selenium.
• Develop test strategies using BDD, TDD, and ATDD; integrate automation into CI/CD.
• Identify coverage gaps and edge cases to improve automation.
• Use Jira and test management tools to manage test cases, defects, and metrics.
• Collaborate with Engineering, Product, and QA teams to drive quality improvements.

Skills

QA testing

Automation frameworks

Python

JavaScript/TypeScript

pytest

Playwright

Cypress

Selenium

AI/LLM testing

Multi-turn conversations

LLM evaluation frameworks

CI/CD

Jira

Test management

Agile methodologies

BDD/TDD/ATDD

SQL/NoSQL

Non-deterministic AI outputs

Tools

pytest

Playwright

Cypress

Selenium

Jira

Job description

Advanced Tech Placement in Alpharetta/Georgia seeks a hands-on Senior QA Automation Engineer with expertise in traditional testing and AI/LLM-powered applications. Design and execute manual and automated tests for UI and API, build robust automation frameworks, and contribute to CI/CD integration.

You will work with Engineering, Product, and QA teams to improve test coverage, reliability, and efficiency, leveraging Python/JS/TS, pytest, Playwright/Cypress/Selenium, and advanced QA practices.