QA Engineer (PyTest/Jest/Robot Framework) - Hybrid Portugal (3 days/week office)

HumanIT Digital Consulting; Porto; Hybrid; EUR 40,000 - 65,000; Full time

Job summary

HumanIT Digital Consulting in Portugal is seeking a QA Engineer to shape the test strategy for an AI-powered platform, building and maintaining automated suites with PyTest, Jest, and Robot Framework.

You will integrate QA into CI/CD, perform exploratory testing, define quality metrics, and collaborate with developers and SRE to ensure production readiness; fluent English is required. The role offers hybrid work in Porto with three days in the office.

Qualifications

• Master's or Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience)
• 4+ years of professional QA/test engineering experience for backend or full-stack systems
• Strong test-automation skills with PyTest/Jest/Robot Framework or similar
• Hands-on experience testing backend services, REST APIs, and event-driven systems
• Comfortable in Linux environments and on the command line; able to read and contribute to test code
• Experience with CI/CD pipelines (GitLab CI/CD) and quality gates
• Solid understanding of HTTP, networking basics, and observability tooling
• Strong written and verbal communication, able to work asynchronously across teams
• Fluent English

Responsibilities

• Define and evolve the test strategy for the AI Orchestration Platform.
• Design, build, and maintain automated test suites at unit, integration, and end-to-end levels.
• Drive quality into the CI/CD pipeline and ensure fast, reliable developer feedback.
• Perform exploratory and risk-based testing on new and changed features.
• Collaborate with developers and SRE on production readiness reviews and observability of test signals.
• Define and track quality metrics (flake, escaped defects, MTTD).
• Coach and raise the team’s overall quality bar, including AI-powered features testing

Skills

Test automation

QA strategy

REST APIs

Linux

CI/CD

HTTP

English

Communication

Education

Bachelor's or Master's in CS/Engineering

Tools

PyTest

Jest

Robot Framework

Job description

QA Engineer (PyTest/Jest/Robot Framework) - Hybrid Portugal (3 days/week office)

ABOUT THE OPPORTUNITY

Join the engineering team behind an AI Orchestration Platform for a major Belgian telecom operator. This is a rare opportunity to shape a test strategy from the ground up, combining classic backend and API automation with the emerging challenge of testing AI-powered features - a role for a QA engineer who wants real ownership over quality, not just execution of someone else's plan.

PROJECT & CONTEXT

You will define and evolve the test strategy for the AI Orchestration Platform, designing, building, and maintaining automated test suites at the unit, integration, and end-to-end levels using PyTest, Jest, Robot Framework, and similar tools. You'll drive quality into the CI/CD pipeline so developer feedback stays fast and reliable, perform exploratory and risk-based testing on new and changed features, and partner with developers and SRE on production readiness reviews, observability of test signals, and post-release verification. You'll also define and track quality metrics such as flakiness, escaped defects, coverage of critical paths, and mean time to detect, while contributing to the testing of AI-powered features - prompt and response evaluation, regression suites, agent behaviour, and structured-output validation - and coaching developers to raise the team's overall quality bar.

WHAT WE'RE LOOKING FOR (Required)

• Master's or Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience)
• 4+ years of professional experience in QA or test engineering for backend or full-stack systems
• Strong test-automation skills with at least one major framework (PyTest, Jest, Robot Framework, or similar)
• Hands-on experience testing backend services, REST APIs, and event-driven systems
• Comfortable in Linux environments and on the command line; able to read and contribute to test code
• Working experience with CI/CD pipelines (ideally GitLab CI/CD) and quality gates
• Solid understanding of HTTP, networking basics, and observability tooling
• A risk-based, pragmatic view of testing, focused on catching real problems rather than chasing coverage as a vanity metric
• Strong written and verbal communication, comfortable working asynchronously across teams and locations
• Fluent English

NICE TO HAVE (Preferred)

• Portuguese, French, or Dutch language skills
• Experience testing AI-powered features such as prompt/response evaluation, agent behaviour, or structured-output validation
• Experience working on large-scale platforms in telecom or similarly complex environments