QA Analyst – AI & LLM Testing for Web Apps

TransPerfect Translations International; Barcelona; On-site; EUR 45,000 - 65,000; Full time

Benefits offered by this job

AI evaluation training

Global team collaboration

Hands-on QA experience

Job summary

TransPerfect Translations International is seeking a QA Engineer to join its TechOps QA team. You will test flagship product features and AI-powered language solutions, identify weak spots in the codebase, and design creative ways to break software while collaborating with developers to resolve defects, risks and issues.

You will guide test cases, perform manual and automated testing, and ensure high-quality releases across languages.

Qualifications

• Experience in analyzing user stories and translating them into test cases.
• Experience with Azure DevOps or Jira.
• Must have experience with building and executing manual test cases for client Web & GUI applications.
• Experience testing RESTful web services and APIs.
• QA Testing experience- demonstrated ability to write test plans with traceability to each acceptance criterion listed in requirements.

Responsibilities

• Initiate and monitor QA testing, making adjustments for scalability, functionality, and usability.
• Test web applications, creative content and special projects.
• Create test cases vs. RTM Matrix against the user stories to support application development.
• Test the application through both manual and automated means.
• Conduct regression, system, integration, and web services testing.
• Test and ensure that software enhancements and system fixes work flawlessly to meet intended business needs according to defined requirements.
• Make recommendations for revisions or improvements, including product customization, based on client feedback.
• Identify user stories and translate them into test cases as required.
• Identify and log defects using AzureDevOps.
• Provide usability and functionality feedback to developers.
• Assist and collaborate closely with Product Managers, Developers and Release Manager to ensure that the application development is according to the quality assurance standards.
• Work closely in collaboration with the developers, designers and engineers to facilitate the building of applications to spec and on time.
• Provide specific technical guidance on defects to developers.
• Ensure traceability of test cases to requirements.
• Participate in sprint planning meetings and daily standup meetings, working with developers, business analysts, project managers, and other testers.
• Ensure releases are delivered to production only after meeting rigorous quality assurance standards in pre-production environments.
• Test AI-powered features, including AI translation and other language outputs, across multiple languages and locales.
• Evaluate AI translation quality, checking accuracy, terminology, fluency and locale conventions.
• Find and log AI‑specific defects with clear, reproducible evidence.
• Use AI‑assisted tools to speed up test design, test data creation and defect analysis.

Skills

QA testing

Azure DevOps

Jira

REST APIs

AI interest

Tools

Manual testing

Job description

TransPerfect Translations International is seeking a QA Engineer to join its TechOps QA team. You will test flagship product features and AI-powered language solutions, identify weak spots in the codebase, and design creative ways to break software while collaborating with developers to resolve defects, risks and issues.

You will guide test cases, perform manual and automated testing, and ensure high-quality releases across languages.