AI Quality Engineer: AI/ML Testing & RPA Validation

Valiant Technologies LLC; Dallas (TX); Vor Ort; USD 120.000 - 170.000; Vollzeit

Zusammenfassung

Valiant Technologies LLC is seeking an AI Quality Engineer to drive quality transformation across AI, automation, and RPA initiatives. You will validate generative and predictive AI models, ensure production readiness, and uphold ethical compliance while collaborating with cross-functional teams.

You will blend AI/ML testing, AI-driven automation, prompt engineering, and UiPath RPA validation to deliver scalable, trustworthy AI solutions.

Qualifikationen

• 5+ years of experience in Software Quality Engineering.
• 2+ years of AI/ML testing and UiPath automation testing.
• Strong understanding of OCR, NLP, and LLM architectures.
• Experience with Java and Python scripting.

Aufgaben

• Define and execute end-to-end testing and validation frameworks for AI services, including ML models, agentic workflows, and automation solutions.
• Perform data quality audits to validate training and test datasets for bias, noise, and completeness.
• Conduct model performance testing using metrics such as Precision-Recall, F1 Score, and MAE.
• Execute adversarial testing, including prompt injections and perturbed inputs, to identify vulnerabilities and data leakage risks.
• Monitor models in production for data drift and concept drift.
• Ensure ongoing bias and fairness monitoring to maintain ethical AI outputs.
• Act as the primary gatekeeper for AI governance, ensuring adherence to Equifax AI standards and compliance requirements.
• Validate real-time observability and autonomous test generation mechanisms.
• Design and execute test plans and test cases for UiPath RPA solutions.
• Validate AI-to-RPA handoff points, where AI agents trigger bots for structured task execution.
• Document defects, track issues, and manage the defect lifecycle through resolution.

Tools

Java

Selenium

Cucumber

Google Apps

UiPath RPA

Jobbeschreibung

Valiant Technologies LLC is seeking an AI Quality Engineer to drive quality transformation across AI, automation, and RPA initiatives. You will validate generative and predictive AI models, ensure production readiness, and uphold ethical compliance while collaborating with cross-functional teams.

You will blend AI/ML testing, AI-driven automation, prompt engineering, and UiPath RPA validation to deliver scalable, trustworthy AI solutions.