Senior AI QA Consultant - Drive Trusted AI Testing

Deloitte (UK); Alabama; Hybrid; USD 90,000 - 150,000; Full time

Job summary

Deloitte seeks Consultants/Senior Consultants to join a team delivering AI QA and quality engineering for AI-based solutions. You will work with data scientists, engineers and stakeholders to shape testing across the AI SDLC, ensuring robust evaluation and trustworthy AI outcomes.

You will analyze model behavior, validate data, craft test scenarios, and contribute to increasing the maturity of AI testing practices within Deloitte’s QE community.

Qualifications

• Understanding of Traditional AI and Generative AI concepts and terminology.
• Understanding data analysis, data profiling, feature exploration and data validation.
• Awareness of risks in AI systems, such as bias, hallucination and model drift.
• Experience analysing model outputs and linking them to AI-specific quality metrics such as relevance, coherence, accuracy, precision, recall, F1 score.
• Working knowledge of Python (or similar) to support data validation, model evaluation, and AI testing activities.
• Client-facing experience.
• Proven technical ability - combined with strong business acumen.
• Comfortable working in a fast-paced and often changeable client environment.
• Strong academic record.
• Experience in manual test techniques and ability to design, review or execute predefined test cases.
• Experience in automation testing techniques.
• Familiarity with test management tools such as HP ALM, Jira, Azure DevOps or equivalent.
• Exposure to AI governance, responsible AI
• Experience working across the delivery lifecycle, including requirements analysis, defect management, reporting and sign-off.

Responsibilities

• Supporting the design and implementation of AI QA approaches for Traditional AI and Generative AI systems, aligned to the AI lifecycle
• Analysing model behaviour, outputs and performance using appropriate evaluation techniques and metrics
• Developing and executing structured test scenarios to assess model performance, robustness and risk (including edge cases and adversarial inputs)
• Validating input and output data across AI pipelines, focusing on completeness, consistency, correctness and relevance
• Working with teams to prepare, validate and enhance datasets, ensuring they are representative and suitable for model evaluation
• Applying tools and techniques for model observability, monitoring and performance tracking
• Identifying and highlighting Responsible AI risks, including bias, fairness and explainability concerns
• Collaborating with data scientists, engineers and QE practitioners to embed good evaluation and testing practices across the lifecycle
• Contributing to internal knowledge sharing, accelerators and learning initiatives within the AI QA and QE community

Skills

AI QA

Traditional AI

Generative AI

Data validation

Model evaluation

Python

Client-facing

Technical ability

Academic record

Manual testing

Automation testing

HP ALM

Jira

Azure DevOps

Responsible AI

AI governance

Delivery lifecycle

Requirements analysis

Defect management

Reporting

Education

Strong academic record

Tools

HP ALM

Jira

Azure DevOps

Job description

Deloitte seeks Consultants/Senior Consultants to join a team delivering AI QA and quality engineering for AI-based solutions. You will work with data scientists, engineers and stakeholders to shape testing across the AI SDLC, ensuring robust evaluation and trustworthy AI outcomes.

You will analyze model behavior, validate data, craft test scenarios, and contribute to increasing the maturity of AI testing practices within Deloitte’s QE community.