AI/ML QA Specialist: Model Behavior & Data Quality

Shore; Porto; Presencial; EUR 45 000 - 70 000; Tempo integral

Resumo da oferta

Shore is seeking an AI/ML QA Analyst to join our team in Porto. The role combines manual and functional testing with hands-on AI/ML knowledge to ensure quality and robustness of AI-powered applications.

You will define AI/ML test strategies, design and execute tests for model behaviour, and collaborate with cross-functional teams in an Agile environment. Strong English communication and a proactive, curious mindset are essential.

Qualificações

• Minimum 3 years of professional experience as a QA Analyst.
• Hands-on knowledge of AI/ML concepts including supervised/unsupervised learning, training, inference, and datasets.
• Experience with API testing tools (SoapUI, Postman).
• Strong SQL skills for data validation.
• Proficiency in Python or scripting for test data preparation.
• Experience with test automation frameworks (Playwright/Selenium/Katalon).
• Background in Agile/SCRUM environments.
• Excellent communication skills in English (French a plus).
• Autonomy, proactive mindset and ability to contribute ideas.

Responsabilidades

• Define and implement test strategies and plans for AI/ML-based systems.
• Design, execute and maintain manual and exploratory tests, including model behaviour and data quality checks.
• Analyze backlog to assess testing feasibility and contribute to testing strategy.
• Estimate testing effort, identify risks, and consider AI/ML model uncertainty.
• Support UAT and ensure alignment with business requirements in AI/ML outputs.
• Review test results, including model outputs and regression impacts.
• Identify and track defects, validate fixes, and monitor model performance over time.
• Prepare test status and issue status reports.
• Validate AI/ML model behavior for correctness, robustness, fairness and explainability.
• Design data quality checks and data pipeline validation scenarios.
• Collaborate with Product Owners on requirements and acceptance criteria.
• Contribute to AI/ML quality metrics and KPIs (accuracy, precision).
• Participate in Agile/SCRUM ceremonies and continuous improvement initiatives.
• Keep up-to-date with AI/ML trends and QA best practices.

Conhecimentos

AI/ML QA

English (Good)

Autonomy

Detail orientation

Analytical thinking

Team collaboration

Curiosity

Formação académica

Bachelor's degree in Computer Science/Software Engineering/Data Science

Ferramentas

JIRA/XRAY

SoapUI

Postman

SQL Developer

Playwright

Selenium

Katalon

Descrição da oferta de emprego

Shore is seeking an AI/ML QA Analyst to join our team in Porto. The role combines manual and functional testing with hands-on AI/ML knowledge to ensure quality and robustness of AI-powered applications.

You will define AI/ML test strategies, design and execute tests for model behaviour, and collaborate with cross-functional teams in an Agile environment. Strong English communication and a proactive, curious mindset are essential.