AI Quality Engineer: AI/ML Testing & UiPath RPA

Robotic Technologies Automation; Dallas (TX); On-site; USD 120,000 - 170,000; Full time

Job summary

Robotic Technologies Automation seeks a highly skilled AI Quality Engineer to drive quality transformation across AI, automation, and RPA initiatives. The role validates generative and predictive AI models, ensures production readiness, and focuses on ethical compliance and scalability.

You will blend AI/ML testing, AI-driven automation, prompt engineering, and UiPath RPA validation while collaborating with cross-functional teams to deliver reliable, auditable AI solutions.

Qualifications

• 5+ years of experience in Software Quality Engineering.
• 2+ years of AI/ML testing and UiPath automation testing.
• Strong understanding of OCR, NLP, and LLM architectures.
• Experience with Java and Python scripting.

Responsibilities

• Define and execute end-to-end testing and validation frameworks for AI services, including ML models, agentic workflows, and automation solutions.
• Perform data quality audits to validate training and test datasets for bias, noise, and completeness.
• Conduct model performance testing using metrics such as Precision-Recall, F1 Score, and MAE.
• Execute adversarial testing, including prompt injections and perturbed inputs, to identify vulnerabilities and data leakage risks.
• Monitor models in production for data drift and concept drift.
• Ensure ongoing bias and fairness monitoring to maintain ethical AI outputs.
• Act as the primary gatekeeper for AI governance, ensuring adherence to Equifax AI standards and compliance requirements.
• Validate real-time observability and autonomous test generation mechanisms.
• Design and execute comprehensive test plans and test cases for UiPath RPA solutions (new and existing implementations).
• Validate AI-to-RPA handoff points, where AI agents trigger bots for structured task execution.
• Document defects, track issues, and manage the defect lifecycle through resolution.

Skills

Java

Selenium

Cucumber

Google Apps

UiPath RPA

Python scripting

Tools

Google Apps

Job description

Robotic Technologies Automation seeks a highly skilled AI Quality Engineer to drive quality transformation across AI, automation, and RPA initiatives. The role validates generative and predictive AI models, ensures production readiness, and focuses on ethical compliance and scalability.

You will blend AI/ML testing, AI-driven automation, prompt engineering, and UiPath RPA validation while collaborating with cross-functional teams to deliver reliable, auditable AI solutions.