Senior AI Test Engineer QA Automation Engineer AI LLM at Houston, TX- Onsite

Propelsys Technologies LLC; Houston (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

Propelsys Technologies LLC in Houston, TX seeks a Senior AI Test Engineer (API & AI Validation) with 10–12 years in Quality Engineering to lead API testing and AI validation efforts. The role emphasizes validating REST APIs, AI/LLM-powered applications, and end-to-end test strategies for AI-enabled systems.

The candidate will design automation frameworks, perform functional and performance testing, and ensure guardrails and responsible AI compliance across services and pipelines.

Qualifications

• 10–12 years of experience in Quality Engineering.
• Hands-on API testing experience.
• Experience validating AI/LLM-powered applications.
• Experience with performance and load testing.

Responsibilities

• Define and implement end-to-end test strategies for AI-enabled applications.
• Design and execute test plans for Generative AI, LLM, RAG, and AI Agent workflows.
• Perform functional, integration, regression, system, and UAT testing.
• Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.
• Develop and maintain API automation frameworks.
• Validate AI model responses for accuracy, relevance, consistency, hallucinations, bias, and toxicity.
• Test prompt engineering scenarios and optimize prompt quality.
• Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.
• Verify AI guardrails, content moderation, and responsible AI compliance.
• Perform database validation using SQL.
• Conduct performance and load testing for APIs and AI services.
• Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers.

Skills

API testing

AI validation

Test automation

REST APIs

SQL

Tools

Postman

Swagger

REST Assured

Job description

Hi ,

Hope you are doing well

Please Find The Job Description (JD) Below.

Role : Senior AI Test Engineer (API & AI Validation)

Location: Houston, TX- Onsite

Job Summary

We are seeking an experienced Senior AI Test Engineer with 10 12 years of experience in Quality Engineering, including hands‑on expertise in API testing and AI application validation. The ideal candidate should have strong experience testing AI/LLM-powered applications, validating REST APIs, designing automation frameworks, and ensuring the quality, reliability, security, and performance of modern AI-enabled systems.

This role requires a blend of traditional testing expertise and knowledge of AI‑specific validation techniques, including prompt testing, model evaluation, hallucination detection, and retrieval validation.

Key Responsibilities

• Define and implement end-to-end test strategies for AI-enabled applications.
• Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.
• Perform functional, integration, regression, system, and UAT testing.
• Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.
• Develop and maintain API automation frameworks.
• Validate AI model responses for:
  • Accuracy
  • Relevance
  • Consistency
  • Hallucinations
  • Bias
  • Toxicity
• Test prompt engineering scenarios and optimize prompt quality.
• Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.
• Verify AI guardrails, content moderation, and responsible AI compliance.
• Perform database validation using SQL.
• Conduct performance and load testing for APIs and AI services.
• Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers.

Thanks & Regards

Madhu Challa

Sr. Technical recruiter

Propelsys Technologies | 4975 Preston Park Boulevard, Suite 70 West

Plano, TX 75093

E: [e-mail]