AI Tester

Valiant Technologies LLC

Irving (TX)

On-site

USD 85,000 - 120,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Valiant Technologies LLC is seeking an experienced AI Tester to validate AI-powered applications, including chatbots and LLM-based solutions. The role emphasizes accuracy, reliability, and performance across manual and automated tests, API testing, and prompt evaluation.

You will collaborate with developers and data science teams, perform Selenium/PyTest automation, test REST APIs and SQL queries, and identify issues like hallucinations and edge cases to improve product quality.

Qualifications

  • Experience in both manual and automated software testing.
  • Familiar with AI/ML-based applications or LLM testing.
  • Strong Python and API testing skills.
  • Knowledge of ChatGPT, Generative AI, and prompt engineering.
  • Experience with Selenium and PyTest frameworks.
  • Proficiency with REST APIs, Postman, and SQL.

Responsibilities

  • Test AI-powered applications, chatbots, and LLM-based solutions.
  • Validate AI-generated responses for accuracy, relevance, and consistency.
  • Perform functional, regression, integration, and API testing.
  • Identify and report bugs, defects, and unexpected AI behavior.
  • Test different prompts and validate AI responses using prompt engineering techniques.
  • Collaborate with developers and data science teams to improve quality.
  • Perform automation testing using Python, Selenium, or similar tools.
  • Validate AI model outputs and test edge cases, hallucinations, and incorrect responses.

Skills

Manual Testing
Automation Testing
Python
API Testing
AI/ML testing
LLM testing
ChatGPT knowledge
Selenium
PyTest
REST APIs
SQL
Postman

Tools

Selenium
PyTest
Postman

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
Job Description :

We are looking for an experienced AI Tester to test and validate AI-powered applications and ensure their accuracy, reliability, and performance. The ideal candidate should have experience in software testing, API testing, automation, and working with AI/ML-based applications.

Key Responsibilities :
  • Test AI-powered applications, chatbots, and LLM-based solutions.
  • Validate AI-generated responses for accuracy, relevance, and consistency.
  • Perform functional, regression, integration, and API testing.
  • Identify and report bugs, defects, and unexpected AI behavior.
  • Test different prompts and validate AI responses using prompt engineering techniques.
  • Work with developers and data science teams to improve application quality.
  • Perform automation testing using Python, Selenium, or similar tools.
  • Validate AI model outputs and test edge cases, hallucinations, and incorrect responses.
Required Skills :
  • Strong experience in Manual and Automation Testing.
  • Knowledge of Python and API Testing.
  • Experience with AI/ML-based applications or LLM testing.
  • Understanding of ChatGPT, Generative AI, and Prompt Engineering.
  • Knowledge of Selenium, PyTest, or similar automation frameworks.
  • Experience with Postman, REST APIs, and SQL.
  • Strong analytical and problem-solving skills.
Preferred Skills :
  • Experience testing chatbots, AI agents, or GenAI applications.
  • Knowledge of RAG (Retrieval-Augmented Generation).
  • Familiarity with AI evaluation frameworks and tools such as LangSmith or Ragas.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Tester
AI Tester

Robotics Technologies LLC • Irving (TX)

On-site
USD 70,000 - 100,000
AI Tester
AI Tester

Ethereum Technologies LLC • Irving (TX)

On-site
USD 90,000 - 130,000
AI Tester
AI Tester

Quantum Technologies LLC • Irving (TX)

On-site
USD 90,000 - 130,000
AI Tester
AI Tester

Robotic Process Automation LLC • Irving (TX)

On-site
USD 80,000 - 140,000
AI Tester
AI Tester

Ethereum Technologies LLC • Chicago (IL)

On-site
USD 90,000 - 120,000
AI Tester
AI Tester

Valiant Technologies LLC • Chicago (IL)

On-site
USD 70,000 - 110,000
AI Tester
AI Tester

Robotic Process Automation LLC • Chicago (IL)

On-site
USD 83,000 - 107,000
AI Tester
AI Tester

Quantum Technologies LLC • Chicago (IL)

On-site
USD 77,000 - 110,000
AI Engineer
AI Engineer

Robotic Process Automation LLC • Raleigh (NC)

On-site
USD 120,000 - 180,000
AI Engineer
AI Engineer

Quantum Technologies LLC • Raleigh (NC)

On-site
USD 120,000 - 180,000