Senior AI QA Consultant - Drive Trusted AI Testing

Deloitte (UK)

Alabama

Hybrid

USD 90,000 - 150,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Deloitte seeks Consultants/Senior Consultants to join a team delivering AI QA and quality engineering for AI-based solutions. You will work with data scientists, engineers and stakeholders to shape testing across the AI SDLC, ensuring robust evaluation and trustworthy AI outcomes.

You will analyze model behavior, validate data, craft test scenarios, and contribute to increasing the maturity of AI testing practices within Deloitte’s QE community.

Qualifications

  • Understanding of Traditional AI and Generative AI concepts and terminology.
  • Understanding data analysis, data profiling, feature exploration and data validation.
  • Awareness of risks in AI systems, such as bias, hallucination and model drift.
  • Experience analysing model outputs and linking them to AI-specific quality metrics such as relevance, coherence, accuracy, precision, recall, F1 score.
  • Working knowledge of Python (or similar) to support data validation, model evaluation, and AI testing activities.
  • Client-facing experience.
  • Proven technical ability - combined with strong business acumen.
  • Comfortable working in a fast-paced and often changeable client environment.
  • Strong academic record.
  • Experience in manual test techniques and ability to design, review or execute predefined test cases.
  • Experience in automation testing techniques.
  • Familiarity with test management tools such as HP ALM, Jira, Azure DevOps or equivalent.
  • Exposure to AI governance, responsible AI
  • Experience working across the delivery lifecycle, including requirements analysis, defect management, reporting and sign-off.

Responsibilities

  • Supporting the design and implementation of AI QA approaches for Traditional AI and Generative AI systems, aligned to the AI lifecycle
  • Analysing model behaviour, outputs and performance using appropriate evaluation techniques and metrics
  • Developing and executing structured test scenarios to assess model performance, robustness and risk (including edge cases and adversarial inputs)
  • Validating input and output data across AI pipelines, focusing on completeness, consistency, correctness and relevance
  • Working with teams to prepare, validate and enhance datasets, ensuring they are representative and suitable for model evaluation
  • Applying tools and techniques for model observability, monitoring and performance tracking
  • Identifying and highlighting Responsible AI risks, including bias, fairness and explainability concerns
  • Collaborating with data scientists, engineers and QE practitioners to embed good evaluation and testing practices across the lifecycle
  • Contributing to internal knowledge sharing, accelerators and learning initiatives within the AI QA and QE community

Skills

AI QA
Traditional AI
Generative AI
Data validation
Model evaluation
Python
Client-facing
Technical ability
Academic record
Manual testing
Automation testing
HP ALM
Jira
Azure DevOps
Responsible AI
AI governance
Delivery lifecycle
Requirements analysis
Defect management
Reporting

Education

Strong academic record

Tools

HP ALM
Jira
Azure DevOps

Job description

Deloitte seeks Consultants/Senior Consultants to join a team delivering AI QA and quality engineering for AI-based solutions. You will work with data scientists, engineers and stakeholders to shape testing across the AI SDLC, ensuring robust evaluation and trustworthy AI outcomes.

You will analyze model behavior, validate data, craft test scenarios, and contribute to increasing the maturity of AI testing practices within Deloitte’s QE community.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Quality Engineering Leader - Associate Director
AI Quality Engineering Leader - Associate Director

London, Manchester • Alabama

Hybrid
USD 119,000 - 172,000
Hybrid working
Senior AI Quality Engineering Leader
Senior AI Quality Engineering Leader

London, Manchester • Alabama

Hybrid
USD 119,000 - 172,000
Associate Director, AI Quality Assurance Leader
Associate Director, AI Quality Assurance Leader

London, Manchester • Alabama

Hybrid
USD 119,000 - 212,000
Hybrid working policy
Senior AI Quality Architect & Testing Leader
Senior AI Quality Architect & Testing Leader

TEKsystems • United States

Remote
USD 128,000 - 192,000
Medical, Dental, Vision
401(k) Retirement Plan
Life Insurance
+4
Senior AI & Data Platform Engineer
Senior AI & Data Platform Engineer

Digitailor • New York (NY)

On-site
USD 131,000 - 219,000
AI-Driven QA Analyst (Mid/Senior)
AI-Driven QA Analyst (Mid/Senior)

Ciandt • United States

Remote
USD 70,000 - 110,000
Health and dental insurance
Meal and food allowance
Childcare assistance
+9
Senior AI Test Engineer (Remote) – QA Leader in AI
Senior AI Test Engineer (Remote) – QA Leader in AI

Testpros • Sterling (VA)

Hybrid
USD 69,000 - 110,000
Remote-friendly
Flexible schedule
AI Quality Assurance Lead for AI-Powered Solutions
AI Quality Assurance Lead for AI-Powered Solutions

McDermott • Atlanta (GA)

Remote
USD 93,000 - 142,000
Remote-first team
Performance-based bonus
Senior QA Engineer: AI-Driven Testing & Quality Champion
Senior QA Engineer: AI-Driven Testing & Quality Champion

Ciandt • United States

Remote
USD 70,000 - 110,000
Health and dental insurance
Meal/food allowance
Continuous learning (CI&T University)
+1
Remote AI Solutions QA Analyst
Remote AI Solutions QA Analyst

McDermott • San Diego (CA)

Remote
USD 93,000 - 142,000