Remote Senior AI Testing & Automation Engineer

ITDS; Portugal; Híbrido; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

ITDS is seeking a Senior AI & Automation QA Engineer to build and maintain testing infrastructure for AI features across conversational AI, productivity tools, and rating systems. You will ensure accuracy, safety, and regression-free performance in production-grade AI applications.

Based in Porto with remote work options, the role emphasizes AI-specific testing challenges, dataset design, and integration into CI/CD pipelines for robust evaluation and observability of model outputs.

Qualificações

• 3+ years of QA/SDET experience, focusing on automation testing.
• Hands-on experience building automated test frameworks with Playwright, Cypress, or Selenium.
• Experience addressing AI-specific testing challenges, including prompt regression and bias detection.

Responsabilidades

• Develop and maintain automated test frameworks to validate AI features.
• Design evaluation datasets and automated pipelines for AI testing.
• Analyze AI outputs to identify errors, hallucinations, and biases for continuous improvement.
• Integrate AI evaluation and functional tests into CI/CD pipelines.

Conhecimentos

Automation Testing

Root Cause Analysis

Ferramentas

Playwright

Cypress

Selenium

Descrição da oferta de emprego

ITDS is seeking a Senior AI & Automation QA Engineer to build and maintain testing infrastructure for AI features across conversational AI, productivity tools, and rating systems. You will ensure accuracy, safety, and regression-free performance in production-grade AI applications.

Based in Porto with remote work options, the role emphasizes AI-specific testing challenges, dataset design, and integration into CI/CD pipelines for robust evaluation and observability of model outputs.