GenAI & AI Testing Engineer - QA & Automation

Ethereum Technologies LLC; Irving (TX); On-site; USD 90,000 - 130,000; Full time

Job summary

Ethereum Technologies is seeking an experienced AI Tester to validate AI-powered applications, ensuring accuracy, reliability, and performance. The role focuses on testing APIs, automation, and AI/ML components to deliver robust software.

Collaborate with developers and data scientists, perform comprehensive manual and automated testing, including prompt engineering, edge cases, and AI model verification using Python, Selenium, PyTest, and Postman.

Qualifications

• Experience in manual and automation testing across API and UI layers.
• Strong knowledge of Python for test scripting and API testing.
• Proven experience with AI/ML-based applications or LLMS testing.
• Understanding of ChatGPT, Generative AI concepts and prompt engineering.

Responsibilities

• Test AI-powered applications, chatbots, and LLM-based solutions.
• Validate AI-generated responses for accuracy, relevance, and consistency.
• Perform functional, regression, integration, and API testing.
• Identify and report bugs, defects, and unexpected AI behavior.
• Test different prompts and validate AI responses using prompt engineering techniques.
• Collaborate with developers and data scientists to improve quality.
• Perform automation testing using Python, Selenium, or similar tools.
• Validate AI model outputs and test edge cases and hallucinations.

Skills

Manual testing

Automation testing

Python

API testing

AI/ML testing

ChatGPT / Generative AI

Selenium / PyTest

Postman / REST APIs

SQL

Job description

Ethereum Technologies is seeking an experienced AI Tester to validate AI-powered applications, ensuring accuracy, reliability, and performance. The role focuses on testing APIs, automation, and AI/ML components to deliver robust software.

Collaborate with developers and data scientists, perform comprehensive manual and automated testing, including prompt engineering, edge cases, and AI model verification using Python, Selenium, PyTest, and Postman.