AI Tester

Robotics Technologies; Irving (TX); On-site; USD 70,000 - 100,000; Full time

Job summary

Robotics Technologies LLC in Irving, TX is seeking an experienced AI Tester to validate AI-powered applications, focusing on accuracy, reliability and performance. You will conduct manual and automated tests, including API tests, with emphasis on prompt engineering and edge-case evaluation.

Join a collaborative team of developers and data scientists to improve product quality. Strong scripting, testing fundamentals, and experience with AI/ML tooling are required.

Qualifications

• Experience with manual and automated software testing.
• Proficient in Python and API testing.
• Experience with AI/ML or LLM testing.
• Familiar with prompt engineering and ChatGPT.
• Experience with Selenium, PyTest, and automation frameworks.
• Proficient in Postman, REST APIs, and SQL.

Responsibilities

• Test AI-powered applications and chatbots.
• Validate AI responses for accuracy and relevance.
• Perform functional, regression, and API testing.
• Identify and report defects and unusual AI behavior.
• Test prompts and evaluate edge cases including hallucinations.
• Collaborate with developers and data science teams.
• Automate tests using Python and Selenium.

Skills

Manual Testing

Automation Testing

Python

API Testing

AI/ML testing

LLM testing

Selenium

PyTest

Postman

REST APIs

SQL

Tools

Selenium

PyTest

Postman

REST APIs

SQL

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description :

We are looking for an experienced AI Tester to test and validate AI-powered applications and ensure their accuracy, reliability, and performance. The ideal candidate should have experience in software testing, API testing, automation, and working with AI/ML-based applications.

Key Responsibilities :

• Test AI-powered applications, chatbots, and LLM-based solutions.
• Validate AI-generated responses for accuracy, relevance, and consistency.
• Perform functional, regression, integration, and API testing.
• Identify and report bugs, defects, and unexpected AI behavior.
• Test different prompts and validate AI responses using prompt engineering techniques.
• Work with developers and data science teams to improve application quality.
• Perform automation testing using Python, Selenium, or similar tools.
• Validate AI model outputs and test edge cases, hallucinations, and incorrect responses.

Required Skills :

• Strong experience in Manual and Automation Testing.
• Knowledge of Python and API Testing.
• Experience with AI/ML-based applications or LLM testing.
• Understanding of ChatGPT, Generative AI, and Prompt Engineering.
• Knowledge of Selenium, PyTest, or similar automation frameworks.
• Experience with Postman, REST APIs, and SQL.
• Strong analytical and problem-solving skills.

Preferred Skills :

• Experience testing chatbots, AI agents, or GenAI applications.
• Knowledge of RAG (Retrieval-Augmented Generation).
• Familiarity with AI evaluation frameworks and tools such as LangSmith or Ragas.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.