AI engineer

Valiant Technologies LLC; Dallas (TX); On-site; USD 120,000 - 170,000; Full time

Job summary

Valiant Technologies LLC is seeking an AI Quality Engineer to drive quality transformation across AI, automation, and RPA initiatives. You will validate generative and predictive AI models, ensure production readiness, and uphold ethical compliance while collaborating with cross-functional teams.

You will blend AI/ML testing, AI-driven automation, prompt engineering, and UiPath RPA validation to deliver scalable, trustworthy AI solutions.

Qualifications

• 5+ years of experience in Software Quality Engineering.
• 2+ years of AI/ML testing and UiPath automation testing.
• Strong understanding of OCR, NLP, and LLM architectures.
• Experience with Java and Python scripting.

Responsibilities

• Define and execute end-to-end testing and validation frameworks for AI services, including ML models, agentic workflows, and automation solutions.
• Perform data quality audits to validate training and test datasets for bias, noise, and completeness.
• Conduct model performance testing using metrics such as Precision-Recall, F1 Score, and MAE.
• Execute adversarial testing, including prompt injections and perturbed inputs, to identify vulnerabilities and data leakage risks.
• Monitor models in production for data drift and concept drift.
• Ensure ongoing bias and fairness monitoring to maintain ethical AI outputs.
• Act as the primary gatekeeper for AI governance, ensuring adherence to Equifax AI standards and compliance requirements.
• Validate real-time observability and autonomous test generation mechanisms.
• Design and execute test plans and test cases for UiPath RPA solutions.
• Validate AI-to-RPA handoff points, where AI agents trigger bots for structured task execution.
• Document defects, track issues, and manage the defect lifecycle through resolution.

Tools

Java

Selenium

Cucumber

Google Apps

UiPath RPA

Job description

We are seeking a highly skilled AI Quality Engineer to drive quality transformation across AI , automation, and RPA initiatives. The ideal candidate will be responsible for validating generative and predictive AI models, ensuring production readiness, ethical compliance, and scalability. This role blends AI /ML testing, AI -driven automation, prompt engineering , and UiPath RPA validation, while collaborating closely with cross-functional teams.

Must-Have Skills

• Java
• Selenium, Cucumber
• Google Apps
• UiPath RPA

Key Responsibilities

AI & Model Quality Assurance

Define and executeend-to-end testing and validation frameworksfor AI services, including ML models, agentic workflows, and automation solutions.

Performdata quality auditsto validate training and test datasets for bias, noise, and completeness.

Conductmodel performance testingusing advanced metrics such as Precision-Recall, F1 Score, and Mean Absolute Error (MAE).

Executeadversarial testing, including prompt injections and perturbed inputs, to identify vulnerabilities and data leakage risks.

Monitor models in production fordata drift and concept drift.

Ensure ongoingbias and fairness monitoringto maintain ethical AI outputs.

AI Governance & Compliance

Act as theprimary gatekeeper for AI governance, ensuring adherence to Equifax AI standards and compliance requirements.

Validate real-time observability and autonomous test generation mechanisms.

Automation & RPA Testing

Design and execute comprehensivetest plans and test casesfor UiPath RPA solutions (new and existing implementations).

Validate AI -to-RPA handoff points, where AI agents trigger bots for structured task execution.

Document defects, track issues, and manage the defect lifecycle through resolution.

Required Qualifications & Experience

• 5+ yearsof experience in Software Quality Engineering .
• 2+ yearsof hands-on experience in AI /ML testing and UiPath automation testing.
• Strong understanding ofOCR, NLP, and LLM architectures.
• Experience withJavaandPython scripting.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.