QA Engineer II — AI Conversational Testing

Nxtwave Disruptive Technologies(Hiring for a Client); United States; Remote; USD 85,000 - 120,000; Full time

Job summary

Nxtwave Disruptive Technologies(Hiring for a Client) is seeking a QA Engineer II to ensure the quality, reliability, and performance of Conversational AI applications. The role requires strong software testing fundamentals, hands-on Python and Bash scripting, and familiarity with Playwright or Selenium for automation.

The position involves testing AI agents, evaluating their behavior, and maintaining reliable benchmarks for continuous quality improvements within an Agile environment.

Qualifications

• Strong fundamentals of software testing and QA processes.
• Experience with Python and Bash scripting for test automation.
• Familiarity with Playwright or Selenium for automation.

Responsibilities

• Design, create, manage, and maintain test benchmarks for AI agents and LLM-based applications.
• Perform functional, regression, and manual testing to validate behavior and identify defects.
• Evaluate AI-generated responses based on semantic accuracy and task completion.
• Support test automation and benchmarking using Python scripts.
• Test WebSocket communications and validate message payloads.
• Document defects and cooperate with developers and QA teams.
• Maintain test cases, plans, and coverage documentation.
• Prepare quality reports for releases and track improvements in test coverage.
• Support performance and load testing using JMeter.
• Participate in Agile development cycles and drive quality improvements.

Skills

Python

Bash scripting

Manual testing

Test case design

Debugging

Tools

Playwright

Selenium

JMeter

Job description

Nxtwave Disruptive Technologies(Hiring for a Client) is seeking a QA Engineer II to ensure the quality, reliability, and performance of Conversational AI applications. The role requires strong software testing fundamentals, hands-on Python and Bash scripting, and familiarity with Playwright or Selenium for automation.

The position involves testing AI agents, evaluating their behavior, and maintaining reliable benchmarks for continuous quality improvements within an Agile environment.