Sr. SDET

Advanced Tech Placement; Alpharetta (GA); On-site; USD 120,000 - 160,000; Full time

Job summary

Advanced Tech Placement in Alpharetta/Georgia seeks a hands-on Senior QA Automation Engineer with expertise in traditional testing and AI/LLM-powered applications. Design and execute manual and automated tests for UI and API, build robust automation frameworks, and contribute to CI/CD integration.

You will work with Engineering, Product, and QA teams to improve test coverage, reliability, and efficiency, leveraging Python/JS/TS, pytest, Playwright/Cypress/Selenium, and advanced QA practices.

Qualifications

• Hands-on QA testing—manual and automated; strong API/UI testing experience.
• Proficient in Python, JavaScript or TypeScript; comfort with test automation.
• Experience with modern QA tools: pytest, Playwright, Cypress, Selenium.
• Experience testing AI/LLM-powered applications and agentic workflows.
• Ability to design tests for multi-turn conversations and non-deterministic AI outputs.
• Familiar with LLm evaluation frameworks and regression testing.
• Knowledge of BDD, TDD, ATDD and Agile methodologies; CI/CD familiarity.
• Experience with SQL/NoSQL databases and QA tooling like Jira.

Responsibilities

• Design and execute manual and automated tests for UI, API, integration, end-to-end, and regression testing.
• Test AI agents, multi-turn conversations, LLM outputs, and agentic workflows.
• Build evaluation frameworks and regression suites to measure LLM quality and reliability.
• Automate API and UI testing using Python, JS/TS, pytest, Playwright, Cypress, or Selenium.
• Develop test strategies using BDD, TDD, and ATDD; integrate automation into CI/CD.
• Identify coverage gaps and edge cases to improve automation.
• Use Jira and test management tools to manage test cases, defects, and metrics.
• Collaborate with Engineering, Product, and QA teams to drive quality improvements.

Skills

QA testing

Automation frameworks

Python

JavaScript/TypeScript

pytest

Playwright

Cypress

Selenium

AI/LLM testing

Multi-turn conversations

LLM evaluation frameworks

CI/CD

Jira

Test management

Agile methodologies

BDD/TDD/ATDD

SQL/NoSQL

Non-deterministic AI outputs

Tools

pytest

Playwright

Cypress

Selenium

Jira

Job description

Senior QA Automation Engineer- AI-Enabled TestingOverview

We are looking for a hands-on QA Automation Engineer/SDET with strong experience in traditional software testing and ideally AI/LLM-powered applications. This person should be skilled in manual and automated testing, API/UI automation, and CI/CD, with experience testing AI agents, multi-turn conversations, and LLM outputs.

This is not an AI research role. We need a strong QA Automation Engineer who can apply AI and modern automation practices to improve software quality, test coverage, and testing efficiency.

Responsibilities

• Design and execute manual and automated tests for UI, API, integration, end-to-end, and regression testing.
• Test AI agents, multi-turn conversations, LLM outputs, and agentic workflows.
• Build evaluation frameworks and regression suites to measure LLM quality, reliability, and consistency.
• Automate API and UI testing using Python, JavaScript/TypeScript, pytest, Playwright, Cypress, or Selenium.
• Develop test strategies using BDD, TDD, and ATDD methodologies.
• Integrate automation into CI/CD pipelines.
• Identify coverage gaps, edge cases, and opportunities to improve automation.
• Use Jira and test management tools to manage test cases, defects, and quality metrics.
• Collaborate with Engineering, Product, and QA teams to drive quality improvements.

Required Skills

• Strong experience in manual and automated QA testing.
• Programming experience in Python, JavaScript, or TypeScript.
• Experience with pytest, Playwright, Cypress, or Selenium.
• Strong API and UI automation experience.
• Experience testing LLM-powered applications, AI agents, or agentic workflows.
• Experience designing tests for multi-turn conversations and non-deterministic AI outputs.
• Experience with LLM evaluation frameworks and regression testing.
• Knowledge of BDD, TDD, ATDD, and Agile methodologies.
• Experience with CI/CD, Jira/test management, SQL/NoSQL, and related QA tools.
• Demonstrated hands-on use of AI/GenAI tools for testing and automation.