Mid-Level Qa Analyst – Ai/Ml Systems Validation

Itds Portugal; Porto; Hybrid; EUR 32,000 - 52,000; Full time

Job summary

ITDS Portugal is seeking a Mid-Level QA Analyst to validate AI/ML powered applications within a leading financial institution’s unit. You will design and execute test plans focusing on model accuracy, fairness, robustness, and data quality, while aligning with business goals and regulatory needs.

You will collaborate with product owners, data scientists, and UAT teams, contribute to backlog grooming, and drive testing activities within Agile Scrum ceremonies in a hybrid Porto setting.

Qualifications

• 4+ years as QA Analyst in Agile environments.
• Experience testing AI/ML systems with focus on model accuracy and data validation.
• Proficient in API testing, SQL data checks, and test management tools.

Responsibilities

• Develop test strategies and plans for AI/ML systems, including edge cases and fairness.
• Validate AI/ML models by checking accuracy metrics and data pipelines.
• Assess backlog stories and estimate testing efforts with Product Owners.

Skills

QA Testing

Agile Methodologies

API Testing

SQL Validation

Python Scripting

Jira Xray

UAT Involvement

English Proficiency

Education

Data Science

Computer Science

Software Engineering

Tools

Postman

SoapUI

Jira

Xray

Python

SQL

Selenium

Playwright

Job description

Hook – Inspire Innovation and Precision in AI/ML Validation

Empower the future of AI — deliver flawless, fair, and reliable intelligent systems!

Location & Work Model

Porto, Portugal — Hybrid work arrangement with up to 2 remote days per week

Introduction

As a Mid-Level QA Analyst, you will be working for our client, a leading financial institution’s innovative Business Unit. You will contribute to the validation and testing of AI-powered applications, ensuring their functional reliability, fairness, robustness, and performance. This role bridges advanced AI/ML model evaluation with standard quality assurance practices, offering a unique opportunity to shape cutting-edge AI solutions with high impact and scope for professional growth.

Your main responsibilities:

• Develop and implement test strategies, plans, and manual/exploratory test cases specifically tailored for AI/ML systems, addressing model fairness, explainability, and edge cases.
• Validate AI/ML models by assessing prediction accuracy, data pipeline integrity, and data quality, contributing to defining success metrics such as precision, recall, and model bias.
• Analyze backlog user stories, estimate testing efforts considering AI data variability, and challenge AI model requirements with Product Owners.
• Manage defect tracking and reporting using Jira and Xray, supporting defect resolution and UAT activities.
• Collaborate with business stakeholders and UAT teams to ensure models’ outputs meet functional and business expectations.
• Participate actively in Agile Scrum ceremonies, sprint planning, and backlog refinement to ensure seamless integration of testing activities within development cycles.

You’re ideal for this role if you have:

• At least 4 years of experience as a QA Analyst, with hands-on testing of complex applications in Agile environments.
• Strong knowledge of API testing (Postman, SoapUI) and SQL data validation.
• Practical experience in testing AI/ML models, understanding model accuracy metrics, and validating data pipelines.
• Proficiency with Jira and Xray for test management.
• Skills in scripting languages such as Python for test data preparation.
• Excellent command of English; French language skills are a strong plus.

It is a strong plus if you have:

• Experience with automated testing frameworks like Selenium or Playwright.
• Background in Data Science, Computer Science, or Software Engineering.

Language Required for the role:

Fluent English. Fluent or working proficiency in French is highly desirable.

Eligibility for the role:

Only candidates with an existing legal right to work in the European Union will be considered for this role.