Senior GenAI QA Engineer (Hybrid)

Johnson & Johnson Innovative Medicine; Madrid; Híbrido; EUR 70.000 - 110.000; Jornada completa

Descripción de la vacante

Johnson & Johnson Innovative Medicine is seeking a Senior Engineer for GenAI QA, based in Madrid or Barcelona with hybrid work. You will design and validate QA strategies for GenAI pipelines, collaborate with data scientists and developers, and drive testing across the product lifecycle to ensure robust, safe AI-powered solutions.

You will bring strong Python skills, experience with LLM-based systems, and hands-on work with cloud platforms.

Formación

• Strong software engineering background with QA ownership.
• Familiarity with RAG & Graph frameworks.
• 3+ years of experience as a software engineer or QA engineer in production systems; 1 year in GenAI.
• Advanced Python skills.
• Experience with LLM-based systems in real environments.
• Hands-on experience with GenAI tools and cloud platforms (AWS, Azure, GCP).
• Proven ability to implement test frameworks for GenAI applications.
• Knowledge of API testing, data validation, and data pipeline testing.
• Experience with version control (Git).
• Experience with building and deploying AI/ML products through the full product lifecycle.
• Understanding of scientific computing and ML frameworks.
• Understanding safety, bias, and failure modes of GenAI systems.
• Proactive problem-solver; able to work independently and in a team.

Responsabilidades

• Design and implement automated and manual QA strategies for GenAI systems.
• Build regression tests and evaluation pipelines for accuracy, grounding, robustness, and safety.
• Validate prompt logic, model behavior and evaluation metrics.
• Execute tests and debug pipelines.
• Support deployment of GenAI products.
• Lead system design reviews for GenAI architectures and reliability.
• Collaborate with data scientists and developers to embed testing checkpoints.
• Establish testing standards and CI/CD workflows.
• Conduct code reviews focusing on design and testability.
• Document system decisions, test cases, and best practices.
• Collaborate with stakeholders to validate developed solutions.

Conocimientos

Python

GenAI QA

LLM-based systems

QA ownership

Full product lifecycle

Herramientas

Git

Docker

Jenkins

Prometheus

Grafana

SonarQube

AWS

Azure

GCP

Descripción del empleo

Johnson & Johnson Innovative Medicine is seeking a Senior Engineer for GenAI QA, based in Madrid or Barcelona with hybrid work. You will design and validate QA strategies for GenAI pipelines, collaborate with data scientists and developers, and drive testing across the product lifecycle to ensure robust, safe AI-powered solutions.

You will bring strong Python skills, experience with LLM-based systems, and hands-on work with cloud platforms.