AI QA Engineer

Quantum World Technologies Inc.; Dallas (TX); On-site; USD 90,000 - 120,000; Full time

Job summary

Quantum World Technologies Inc. in Dallas, TX is seeking a QA Automation Engineer to design and execute test strategies for AI/ML applications, validate LLM outputs and prompts, and ensure data accuracy across end-to-end pipelines.

You will develop automated tests in Python using Playwright or Selenium, perform API testing with Postman, test functional, regression and integration areas, and collaborate with developers to identify defects and improve reliability.

Qualifications

• Experience in QA testing and test automation.
• Knowledge of GenAI, LLMs, and prompt testing.
• Proficiency in Python and automation tools (Playwright or Selenium).
• Experience with API testing and Postman.
• Understanding of functional, regression and integration testing.

Responsibilities

• Design and execute test cases for AI/ML and Generative AI applications.
• Perform functional, regression, integration, and API testing.
• Validate LLM outputs, prompts, and AI-generated responses.
• Develop and maintain automated test scripts using Python, Selenium, or Playwright.
• Test RAG pipelines, chatbot workflows, and AI model responses.
• Identify defects, analyze results, and collaborate with development teams.
• Validate application performance, reliability, and data accuracy.

Skills

QA testing & automation

GenAI/LLMs knowledge

Python scripting

API testing

Troubleshooting & analysis

Tools

Playwright

Selenium

Postman

Job description

• Design and execute test cases for AI/ML and Generative AI applications.
• Perform functional, regression, integration, and API testing.
• Validate LLM outputs, prompts, and AI-generated responses.
• Develop and maintain automated test scripts using Python, Selenium, or Playwright.
• Test RAG pipelines, chatbot workflows, and AI model responses.
• Identify defects, analyze results, and collaborate with development teams.
• Validate application performance, reliability, and data accuracy.

Required Skills:

• Experience in QA testing and test automation.
• Knowledge of AI, GenAI, LLMs, and prompt testing.
• Proficiency in Python and automation tools such as Playwright or Selenium.
• Experience with API testing and tools such as Postman.
• Understanding of functional, regression, and integration testing.
• Strong analytical and troubleshooting skills.