QA Engineer | Barcelona

TransPerfect Translations International

Barcelona

On-site

EUR 42,000 - 64,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

TransPerfect Translations International is seeking a QA Engineer to own automated testing for web, API, and AI-enabled products within the TechOps team. You will design and maintain tests, perform exploratory and regression testing, and collaborate with distributed teams to ensure release readiness.

You will work with Playwright or Selenium, contribute to AI-enabled test strategies, and help validate AI/LLM features, including translation outputs, while integrating tests into CI/CD pipelines for

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or equivalent.
  • Professional experience in software quality engineering with manual and automated testing.
  • Hands-on experience developing and maintaining UI or API automation using Playwright, Selenium, or similar frameworks.
  • Programming proficiency in C#, Java, or a comparable language used for test automation.
  • Experience with RESTful API testing, debugging, test-data management, and validation of backend behavior.
  • Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps, TeamCity, or Jira.
  • Ability to analyze requirements, develop risk-based coverage, and maintain traceability from acceptance criteria to test results.
  • Familiarity with AI-assisted coding or testing tools, plus the judgment to review generated code, test cases, and results.
  • Foundational understanding of LLM capabilities and limitations, including hallucinations, variable outputs, and the need for structured evaluation.
  • Strong analytical, troubleshooting, documentation, and communication skills; ability to work independently and collaboratively.

Responsibilities

  • Design, implement, execute, and maintain automated functional, integration, regression, and API tests for web and mobile-enabled applications
  • Build and improve scalable, maintainable test automation frameworks using Playwright, Selenium, or comparable tools, with appropriate code reviews and quality checks
  • Integrate automated tests into CI/CD pipelines, analyze failures, reduce flaky tests, and provide timely feedback on release quality
  • Create risk-based test strategies, test plans, test scenarios, and traceable test cases aligned with user stories and acceptance criteria
  • Perform hands-on exploratory, cross-browser, system, end-to-end, database, and RESTful API testing as needed
  • Validate data integrity, access control, error handling, usability, and compatibility across supported environments
  • Identify, document, prioritize, and track defects in Azure DevOps or comparable tools, supplying clear steps, evidence, impact, and technical findings
  • Work with developers, product managers, QA leads, and release managers to assess risks, investigate defects, and support release-readiness decisions
  • Test AI-powered features and LLM-based workflows for functional correctness, output quality, reliability, and alignment with requirements
  • Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation, terminology, fluency, formatting, and locale conventions; collaborate with language specialists when subject-matter review is needed
  • Design repeatable AI test scenarios and evaluation datasets covering normal, edge, ambiguous, multilingual, and adversarial inputs
  • Identify and document AI-specific failures, including hallucinations, omissions, inconsistent responses, bias, unsafe outputs, and failures to follow instructions or required formats
  • Account for non-deterministic AI behavior by using appropriate evaluation rubrics, comparative baselines, sampling, and repeat testing rather than relying on exact-text assertions alone
  • Use approved AI assistants to accelerate test-case design, test-data preparation, automation scripting, coverage analysis, debugging, and defect reporting; independently verify all AI-generated artifacts
  • Assess the risks of AI-assisted testing workflows, including sensitive-data exposure, unsupported assumptions, fabricated test evidence, and weak assertions; follow company security and data-handling policies
  • Maintain test assets and technical documentation, and proactively recommend improvements to test coverage, effectiveness, and execution efficiency

Skills

Playwright
Selenium
C#
Java
REST API testing
CI/CD
Azure DevOps
Jira
Test automation
Analytical skills

Education

Bachelor’s degree in CS/Engineering or equivalent

Tools

NET
SQL

Job description

TransPerfect helps organizations navigate the global marketplace. Founded in an NYU dorm room in 1992 and still founder-led, TransPerfect has grown into the world’s largest translation and language services company, with thousands of employees across more than 160 offices worldwide and over $1.3 billion in annual revenue.

The TransPerfect TechOps team builds and supports the technology behind that success – from workflow improvements and core GlobalLink platform services to AI-powered language solutions and scalable client-facing applications.

As a QA Engineer, you will help ensure the quality, reliability, security, and performance of our web applications, APIs, and AI-enabled products. You will design and maintain automated tests, perform hands-on exploratory and regression testing, and work closely with engineering and product teams to identify risks early. You will also use AI-assisted development and testing tools responsibly and contribute to validating AI/LLM features, including translation and other generated language outputs.

This position offers:
  • A significant role in a dynamic QA team, part of a technology division within the world's largest provider of language services and technology solutions

  • Ownership of test automation and opportunities to influence product quality and release readiness

  • Collaboration with distributed product, development, and release teams

  • Hands-on exposure to AI-enabled products, LLM evaluation, and modern AI-assisted testing workflows

  • Opportunities to expand skills in automation frameworks, API testing, CI/CD, and responsible AI quality practices


Your responsibilities will include:
  • Design, implement, execute, and maintain automated functional, integration, regression, and API tests for web and mobile-enabled applications

  • Build and improve scalable, maintainable test automation frameworks using Playwright, Selenium, or comparable tools, with appropriate code reviews and quality checks

  • Integrate automated tests into CI/CD pipelines, analyze failures, reduce flaky tests, and provide timely feedback on release quality

  • Create risk-based test strategies, test plans, test scenarios, and traceable test cases aligned with user stories and acceptance criteria

  • Perform hands-on exploratory, cross-browser, system, end-to-end, database, and RESTful API testing as needed

  • Validate data integrity, access control, error handling, usability, and compatibility across supported environments

  • Identify, document, prioritize, and track defects in Azure DevOps or comparable tools, supplying clear steps, evidence, impact, and technical findings

  • Work with developers, product managers, QA leads, and release managers to assess risks, investigate defects, and support release-readiness decisions

  • Test AI-powered features and LLM-based workflows for functional correctness, output quality, reliability, and alignment with requirements

  • Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation, terminology, fluency, formatting, and locale conventions; collaborate with language specialists when subject-matter review is needed

  • Design repeatable AI test scenarios and evaluation datasets covering normal, edge, ambiguous, multilingual, and adversarial inputs

  • Identify and document AI-specific failures, including hallucinations, omissions, inconsistent responses, bias, unsafe outputs, and failures to follow instructions or required formats

  • Account for non-deterministic AI behavior by using appropriate evaluation rubrics, comparative baselines, sampling, and repeat testing rather than relying on exact-text assertions alone

  • Use approved AI assistants to accelerate test-case design, test-data preparation, automation scripting, coverage analysis, debugging, and defect reporting; independently verify all AI-generated artifacts

  • Assess the risks of AI-assisted testing workflows, including sensitive-data exposure, unsupported assumptions, fabricated test evidence, and weak assertions; follow company security and data-handling policies

  • Maintain test assets and technical documentation, and proactively recommend improvements to test coverage, effectiveness, and execution efficiency

Communication:
  • Communicate test progress, quality risks, defects, and release blockers clearly to QA, development, and product stakeholders

  • Collaborate effectively with cross-functional teams across locations and time zones; participate in Agile planning, refinement, and daily standups

Required skills and experience:
  • Bachelor’s degree in Computer Science, Engineering, a related discipline, or equivalent relevant experience

  • Professional experience in software quality engineering with both manual and automated testing

  • Hands-on experience developing and maintaining UI or API automation using Playwright, Selenium, or similar frameworks

  • Programming proficiency in C#, Java, or a comparable language used for test automation

  • Experience with RESTful API testing, debugging, test-data management, and validation of backend behavior

  • Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps, TeamCity, or Jira

  • Ability to analyze requirements, develop risk-based coverage, and maintain traceability from acceptance criteria to test results

  • Familiarity with AI-assisted coding or testing tools, plus the judgment to review and validate generated code, test cases, and results

  • Foundational understanding of LLM capabilities and limitations, including hallucinations, variable outputs, and the need for structured evaluation

  • Strong analytical, troubleshooting, documentation, and communication skills; ability to work independently and collaboratively

Desired skills and experience:
  • Experience testing AI/LLM applications, machine translation, retrieval-augmented generation (RAG), or other generative AI features

  • Experience creating automated AI evaluations, quality rubrics, curated datasets, or regression benchmarks for model-generated outputs

  • Knowledge of AI security and safety test scenarios, including prompt injection, data leakage, and inappropriate output handling

  • Experience with .NET development, SQL/database validation, performance or load testing, and service virtualization

  • Experience with AI coding assistants or agent-based QA workflows, including tool integrations and human-in-the-loop validation

  • Professional working knowledge of an additional language, especially for multilingual product testing

  • Ability to work across time zones and understand complex business workflows

By applying, I confirm I have read and accept TransPerfect's Privacy Policy: https://www.transperfect.com/about/data-privacy-recruiting

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

QA Analyst | Barcelona
QA Analyst | Barcelona

TransPerfect • Barcelona

On-site
EUR 45,000 - 65,000
AI evaluation training
Global team collaboration
Hands-on QA experience
QA Engineer: AI-Powered Testing for Web & Multilingual Apps
QA Engineer: AI-Powered Testing for Web & Multilingual Apps

TransPerfect Translations International • Barcelona

On-site
EUR 42,000 - 64,000
QA Analyst – AI & LLM Testing for Web Apps
QA Analyst – AI & LLM Testing for Web Apps

TransPerfect • Barcelona

On-site
EUR 45,000 - 65,000
AI evaluation training
Global team collaboration
Hands-on QA experience
Lead Test Framework Architect (M/F/D)
Lead Test Framework Architect (M/F/D)

Agilent • Spain

On-site
EUR 110,000 - 140,000
QA Engineer, AI-Assisted Testing
QA Engineer, AI-Assisted Testing

Xygeni • Spain

Remote
EUR 42,000 - 65,000
Senior QA Test Automation Engineer
Senior QA Test Automation Engineer

Dematic Corp. (ILD-US) • Barcelona

Hybrid
EUR 70,000 - 95,000
Private health insurance
Food Allowance
Hybrid Work Model
+2
Senior QA Automation Engineer — AI & LLM Testing
Senior QA Automation Engineer — AI & LLM Testing

Colonial Heights Senior Living • Spain

On-site
EUR 55,000 - 85,000
Flexible engagement model
Challenging projects
Security compliance
+1
Senior AI Linguist
Senior AI Linguist

TransPerfect • Madrid

On-site
EUR 40,000 - 60,000
AI QA Engineer
AI QA Engineer

develop • Spain

Remote
EUR 60,000 - 100,000
AI QA Engineer — Remote (EU/UK) with LLM Testing
AI QA Engineer — Remote (EU/UK) with LLM Testing

develop • Spain

Remote
EUR 60,000 - 100,000