AI QA Engineer / LLM Test Engineer - 6 Months Contract

Radiant Digital Solutions; United States; Remoto; USD 80.000 - 110.000; Part-time

Descrizione del lavoro

Radiant Digital Solutions LLC is seeking an experienced QA Engineer to test AI/ML applications, focusing on LLM and GenAI solutions. You will perform manual and automated testing, validate prompts and responses, and identify hallucinations across AI workflows.

The role requires hands-on project experience in AI/LLM testing, with Python and automation tools like Selenium or Pytest. Remote work is offered with UAE business hours and immediate joining preferred.

Competenze

• Hands-on testing experience in AI/LLM/GenAI projects.
• Experience validating prompts, responses, and hallucinations.
• Familiarity with RAG evaluation and source grounding.
• Proficiency in Python and automation tools for QA testing.

Mansioni

• Perform manual and automated testing of AI/LLM based applications.
• Validate prompts, responses, and model outputs for accuracy and relevance.
• Identify hallucinations and perform prompt regression testing.
• Collaborate on API testing and defect tracking throughout sprints.

Conoscenze

Manual testing

Automation testing

LLM testing

GenAI testing

Prompt validation

Response validation

Hallucination detection

RAG evaluation

Source grounding

Prompt regression testing

Python

Selenium

Pytest

DeepEval

API testing

Defect tracking

Strumenti

Selenium

Pytest

DeepEval

Descrizione del lavoro

Experience: 4 to 10 Years
Open Positions: 2
Contract: 6 Months (Extendable)
Work Mode: 100% Remote
Working Hours: UAE Business Hours
Joining: Immediate joiners or short notice preferred

Job Description

We are looking for an experienced QA Engineer with hands‑on experience in testing AI/ML-based applications, particularly LLM and Generative AI solutions.

Key Skills Required

• Strong experience in manual and automation testing.
• Hands‑on experience in testing LLM/GenAI applications, including prompt and response validation.
• Experience identifying hallucinations, validating response accuracy, consistency and relevance.
• Knowledge of RAG evaluation, source grounding and prompt regression testing.
• Experience with Python and automation tools such as , Selenium or Pytest.
• Familiarity with AI testing tools such as DeepEval, , or is an advantage.
• Good experience in API testing and defect tracking.

Important: Candidates must have actual project experience in AI/LLM testing. General QA automation experience without hands‑on AI testing will not be considered.