QA Analyst (with AI/ML experience)

Hexa Consulting; Lisboa; Hybrid; EUR 28,000 - 44,000; Full time

Benefits offered by this job

Hybrid work model

Private health insurance from day one

Mental health support via TEAM 24

Childcare vouchers and family support

Continuous learning & certification

Job summary

Hexa Consulting is seeking a Mid QA Analyst (AI) to join our Client's team in a hybrid work model from Lisbon. You will contribute to QA strategies for AI/ML-based systems and collaborate with cross-functional teams in a banking technology environment.

The role requires hands-on testing across manual, functional, exploratory and AI-specific testing, with a strong focus on data quality and model behavior validation, in an Agile SCRUM setting.

Qualifications

• 3+ years as QA Analyst in relevant field.
• Hands-on AI/ML testing and data validation.
• Experience with API testing and SQL data checks.
• Strong communication and documentation skills.
• Proficiency in English in a professional context.

Responsibilities

• Define test strategies and plans for AI/ML systems.
• Execute manual, exploratory, functional and non-functional tests.
• Validate AI model behavior and data quality.
• Review results and support reliable delivery.
• Collaborate in Agile SCRUM ceremonies and report progress.
• Prepare clear test status and defect reports.

Skills

AI/ML concepts

Manual testing

Functional testing

Non-functional testing

Model validation

Data quality checks

JIRA

XRAY

API testing

SQL

Python

Playwright

Selenium

Katalon

Agile SCRUM

Test reporting

Defect tracking

Test effort estimation

English proficiency

Education

Higher education in CS/SE/Data Science

Tools

JIRA

XRAY

SoapUI

Postman

SQL Developer

Python

Playwright

Selenium

Katalon

Job description

Hexa Consulting is looking for a Mid QA Analyst (AI) to join our Client's team in a hybrid work model from Lisbon.

Lisbon, Portugal | Hybrid | Banking technology sector

Mandatory Requirements

• At least 3 years of professional experience as a QA Analyst.
• Hands-on understanding of AI/ML concepts, including supervised and unsupervised learning, model training, inference and datasets.
• Experience with manual, functional, exploratory and non-functional testing.
• Experience with AI/ML testing concepts, including model behavior validation, robustness, fairness, explainability and regression analysis.
• Experience with data quality checks and data pipeline validation.
• Experience with JIRA and XRAY.
• Experience with API testing using SoapUI or Postman.
• Experience with SQL and SQL Developer for data validation.
• Knowledge of Python or scripting for test data preparation.
• Awareness of test automation frameworks such as Playwright, Selenium or Katalon.
• Experience working in Agile SCRUM environments.
• Experience with test reporting, defect tracking and test effort estimation.
• Higher education in Computer Science, Software Engineering, Data Science or an equivalent field.
• Professional working proficiency in English.
• Ability to synthesize information, document clearly and communicate effectively.
• Detail-oriented, proactive and autonomous working style.
• Strong prioritization skills, with the ability to balance risks, business impact and delivery constraints.
• Curiosity and a continuous learning mindset, particularly in AI, data and quality assurance practices.

AI/ML | JIRA | XRAY | SoapUI | Postman | SQL | SQL Developer | Python | Playwright | Selenium | Katalon | Agile SCRUM

Key Responsibilities

• Define test strategies, test plans and testing approaches for AI/ML-based systems.
• Design, execute and maintain manual, exploratory, functional, non-functional and AI-specific test scenarios.
• Analyze backlog items to assess testing feasibility, effort, risk and impact.
• Validate AI model behavior, including correctness, robustness, fairness, explainability, edge cases and regression impacts.
• Review test results, model outputs, prediction behavior and data-related issues to support reliable delivery.
• Design and execute data quality checks and data pipeline validation scenarios.
• Challenge requirements and acceptance criteria with Product Owners, especially for AI-driven outputs.
• Contribute to the definition of AI quality metrics and KPIs, including accuracy and precision.
• Identify, document, track and validate defects, fixes and model performance observations.
• Support UAT activities and ensure business expectations are reflected in test coverage and outputs.
• Prepare clear test status reports, issue reports and delivery updates.
• Participate in Agile SCRUM ceremonies and contribute to continuous improvement.
• Share knowledge with less experienced analysts and provide constructive feedback when relevant.

What We Offer

• Work Model: hybrid.
• A culture where each person is encouraged to act as a Builder, contributing with ownership, responsibility and impact.
• A collaborative environment built on Honesty, Mutual Support and Agility.
• Continuous learning and certification support throughout your journey.
• Private health insurance from day one, with optional family extension.
• Confidential mental health support through TEAM 24, including psychological support, content and live sessions.
• Childcare vouchers and practical family support measures.
• Opportunities to grow through exposure to quality management, information security, AI governance and cybersecurity best practices.

Hexa is committed to equal opportunity, inclusion and fair access to professional growth. We value diverse backgrounds, perspectives and experiences, and we support the principles of the Portuguese Diversity Charter in the way we build teams and opportunities.

Life at Hexa means being part of a community of Builders. We work with transparency, support each other across projects and geographies, and stay focused on learning, adapting and delivering work that creates real impact.