AI engineer

Quantum Technologies. LLC; Dallas (TX); On-site; USD 110,000 - 150,000; Full time

Job summary

Quantum Technologies. LLC is seeking a highly skilled AI Quality Engineer to drive quality transformation across AI, automation, and RPA initiatives. You will validate generative and predictive AI models and ensure production readiness.

You will work on AI/ML testing, AI-driven automation, prompt engineering, and UiPath RPA validation, collaborating with cross-functional teams to deliver scalable, ethical AI solutions.

Qualifications

• 5+ years of experience in Software Quality Engineering.
• 2+ years AI/ML testing and UiPath automation testing.
• Strong understanding of OCR, NLP, and LLM architectures.
• Experience with Java and Python scripting.
• Experience validating AI models for production readiness and ethics.

Responsibilities

• Define and execute end-to-end testing and validation frameworks for AI services.
• Perform data quality audits to validate training and test datasets for bias, noise, and completeness.
• Conduct model performance testing using metrics such as Precision-Recall, F1 Score, and MAE.
• Execute adversarial testing, including prompt injections and perturbed inputs.
• Monitor models in production for data drift and concept drift.
• Design test plans for UiPath RPA solutions and AI-to-RPA handoffs.

Skills

Java

Selenium

Cucumber

Google Apps

UiPath RPA

Job description

We are seeking a highly skilled AI Quality Engineer to drive quality transformation across AI , automation, and RPA initiatives. The ideal candidate will be responsible for validating generative and predictive AI models, ensuring production readiness, ethical compliance, and scalability. This role blends AI /ML testing, AI -driven automation, prompt engineering , and UiPath RPA validation, while collaborating closely with cross-functional teams.

Must-Have Skills

• Java
• Selenium, Cucumber
• Google Apps
• UiPath RPA

Key Responsibilities

AI & Model Quality Assurance

Define and executeend-to-end testing and validation frameworksfor AI services, including ML models, agentic workflows, and automation solutions.

Performdata quality auditsto validate training and test datasets for bias, noise, and completeness.

Conductmodel performance testingusing advanced metrics such as Precision-Recall, F1 Score, and Mean Absolute Error (MAE).

Executeadversarial testing, including prompt injections and perturbed inputs, to identify vulnerabilities and data leakage risks.

Monitor models in production fordata drift and concept drift.

Ensure ongoingbias and fairness monitoringto maintain ethical AI outputs.

AI Governance & Compliance

Act as theprimary gatekeeper for AI governance, ensuring adherence to Equifax AI standards and compliance requirements.

Validate real-time observability and autonomous test generation mechanisms.

Automation & RPA Testing

Design and execute comprehensivetest plans and test casesfor UiPath RPA solutions (new and existing implementations).

Validate AI -to-RPA handoff points, where AI agents trigger bots for structured task execution.

Document defects, track issues, and manage the defect lifecycle through resolution.

Required Qualifications & Experience

• 5+ yearsof experience in Software Quality Engineering .
• 2+ yearsof hands-on experience in AI /ML testing and UiPath automation testing.
• Strong understanding ofOCR, NLP, and LLM architectures.
• Experience withJavaandPython scripting.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.