AI Tester: Validate & Automate GenAI Apps

Quantum Technologies. LLC; Chicago (IL); On-site; USD 77,000 - 110,000; Part time

Job summary

Quantum Technologies LLC in Chicago is seeking an experienced AI Tester to validate AI-powered applications for accuracy, reliability, and performance. The ideal candidate will test AI/ML-based applications, APIs, and prompts, and write automated tests using Python and Selenium.

The role involves collaboration with developers and data scientists, testing edge cases, and ensuring high-quality AI interactions. Work authorization requirements apply as listed.

Qualifications

• Strong experience in manual and automation testing.
• Experience with Python and API testing.
• Experience with AI/ML-based applications or LLM testing.
• Understanding of ChatGPT, Generative AI, and Prompt Engineering.
• Knowledge of Selenium, PyTest, or similar automation frameworks.
• Experience with Postman, REST APIs, and SQL.

Responsibilities

• Test AI-powered applications, chatbots, and LLM-based solutions.
• Validate AI-generated responses for accuracy, relevance, and consistency.
• Perform functional, regression, integration, and API testing.
• Identify and report bugs, defects, and unexpected AI behavior.
• Test different prompts and validate AI responses using prompt engineering techniques.
• Work with developers and data science teams to improve application quality.
• Perform automation testing using Python, Selenium, or similar tools.
• Validate AI model outputs and test edge cases, hallucinations, and incorrect responses.

Job description

Quantum Technologies LLC in Chicago is seeking an experienced AI Tester to validate AI-powered applications for accuracy, reliability, and performance. The ideal candidate will test AI/ML-based applications, APIs, and prompts, and write automated tests using Python and Selenium.

The role involves collaboration with developers and data scientists, testing edge cases, and ensuring high-quality AI interactions. Work authorization requirements apply as listed.