AI Quality Engineer: AI Testing & Validation Lead

TSR Consulting

Irving (TX)

On-site

USD 90,000 - 130,000

Full time

2 days ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

TSR Consulting seeks an AI Quality Engineer to join our team in Irving, TX. You will lead quality assurance for AI/ML models, including Generative AI, and design comprehensive testing strategies that ensure reliability, fairness, and performance of AI systems in production.

You will develop test plans, create edge-case test cases, and drive automation across AI pipelines and model validation. Collaboration with data scientists and cross-functional teams is essential to embed quality throughout

Qualifications

Strong experience in AI and ML quality assurance.
Experience with test automation and model validation.
Ability to design comprehensive testing strategies for AI systems.

Responsibilities

Quality assurance strategy and standards for AI/ML models, including Generative AI.
Develop test strategies and plans covering objectives, scope, resources, and schedules.
Design test cases across functional, non-functional, performance, regression, and adversarial testing.
Assess AI robustness and fairness against edge cases and unexpected scenarios.
Conduct performance and scalability testing for model inference and resource use.
Collaborate with data scientists on data quality and bias assessment.
Develop automation for AI/ML pipelines, model validation, and system integration.
Manage defects from identification to resolution.
Define metrics (accuracy, precision, recall, F1, latency) and report to stakeholders.
Embed quality throughout the AI lifecycle with cross-functional teams.
Pursue continuous improvements from advances in AI testing methodologies.