AI/ML QA Analyst (Porto | Lisboa,Hibrido)

Shore; Porto; Presencial; EUR 45 000 - 70 000; Tempo integral

Resumo da oferta

Shore is seeking an AI/ML QA Analyst to join our team in Porto. The role combines manual and functional testing with hands-on AI/ML knowledge to ensure quality and robustness of AI-powered applications.

You will define AI/ML test strategies, design and execute tests for model behaviour, and collaborate with cross-functional teams in an Agile environment. Strong English communication and a proactive, curious mindset are essential.

Qualificações

• Minimum 3 years of professional experience as a QA Analyst.
• Hands-on knowledge of AI/ML concepts including supervised/unsupervised learning, training, inference, and datasets.
• Experience with API testing tools (SoapUI, Postman).
• Strong SQL skills for data validation.
• Proficiency in Python or scripting for test data preparation.
• Experience with test automation frameworks (Playwright/Selenium/Katalon).
• Background in Agile/SCRUM environments.
• Excellent communication skills in English (French a plus).
• Autonomy, proactive mindset and ability to contribute ideas.

Responsabilidades

• Define and implement test strategies and plans for AI/ML-based systems.
• Design, execute and maintain manual and exploratory tests, including model behaviour and data quality checks.
• Analyze backlog to assess testing feasibility and contribute to testing strategy.
• Estimate testing effort, identify risks, and consider AI/ML model uncertainty.
• Support UAT and ensure alignment with business requirements in AI/ML outputs.
• Review test results, including model outputs and regression impacts.
• Identify and track defects, validate fixes, and monitor model performance over time.
• Prepare test status and issue status reports.
• Validate AI/ML model behavior for correctness, robustness, fairness and explainability.
• Design data quality checks and data pipeline validation scenarios.
• Collaborate with Product Owners on requirements and acceptance criteria.
• Contribute to AI/ML quality metrics and KPIs (accuracy, precision).
• Participate in Agile/SCRUM ceremonies and continuous improvement initiatives.
• Keep up-to-date with AI/ML trends and QA best practices.

Conhecimentos

AI/ML QA

English (Good)

Autonomy

Detail orientation

Analytical thinking

Team collaboration

Curiosity

Formação académica

Bachelor's degree in Computer Science/Software Engineering/Data Science

Ferramentas

JIRA/XRAY

SoapUI

Postman

SQL Developer

Playwright

Selenium

Katalon

Descrição da oferta de emprego

We are looking for an AI/ML QA Analyst to join our team. The successful candidate will combine strong manual and functional testing skills with hands-on knowledge of Artificial Intelligence and Machine Learning systems, ensuring the quality, reliability, and robustness of AI-powered applications. The role involves working closely with development, product, and business teams within an Agile environment, with a particular focus on AI/ML-specific testing, data quality, model behaviour, and continuous improvement.

Responsibilities

• Define and implement test strategies and test plans adapted to AI/ML-based systems.
• Design, execute, and maintain manual and exploratory test cases covering functional, non-functional, and AI/ML-specific scenarios, including model behaviour, edge cases, bias, robustness, and explainability.
• Analyse the product backlog to assess testing feasibility and contribute to the overall testing strategy.
• Estimate testing effort and identify risks, taking into consideration AI/ML model uncertainty and data variability.
• Support UAT activities, ensuring business requirements are accurately reflected in AI/ML outputs.
• Review and analyse test results, including model outputs, prediction accuracy, and regression impacts.
• Identify, track, and report defects, validate fixes, and monitor model performance over time.
• Prepare test status and issue status reports.
• Validate AI/ML model behaviour in terms of correctness, robustness, fairness, and explainability.
• Design and execute data quality checks and data pipeline validation scenarios.
• Challenge AI/ML model requirements and acceptance criteria in collaboration with Product Owners.
• Contribute to the definition of AI/ML quality metrics and KPIs, such as accuracy and precision.
• Participate actively in Agile/SCRUM ceremonies and contribute to continuous improvement initiatives.
• Keep up to date with AI/ML trends and QA best practices and apply relevant insights to improve testing processes.
• Support junior QA analysts by sharing knowledge and providing constructive feedback.

Requisitos mínimos

• Minimum 3 years of professional experience as a QA Analyst.
• Hands-on knowledge and experience with AI/ML concepts, including supervised and unsupervised learning, model training and inference, and datasets.
• Experience with JIRA/XRAY.
• Experience with API testing tools, such as SoapUI or Postman.
• Good knowledge of SQL / SQL Developer for data validation.
• Experience with Python or scripting for test data preparation.
• Knowledge of test automation frameworks such as Playwright, Selenium, or Katalon.
• Higher education in Computer Science, Software Engineering, Data Science, or a related field.
• Previous experience working in an Agile/SCRUM environment.
• Strong communication skills, with the ability to synthesise information and produce clear documentation.
• Strong attention to detail, with a proactive and autonomous approach.
• Proven ability to prioritise activities based on risks and business impact.
• Good level of English; French is considered a plus.
• Demonstrated autonomy, commitment, and ability to contribute with ideas and solutions.
• Curiosity and genuine interest in new technologies, particularly AI/ML and data.