Director of GenAI Quality & Evaluation

Johnson & Johnson Innovation; Madrid; Presencial; EUR 75.000 - 129.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Annual bonus

Vacation days

Parental leave

Descripción de la vacante

Johnson & Johnson Innovation is seeking a senior leader for Data Analytics & Computational Sciences to establish the GenAI Evaluation & Standards function within a regulated pharmaceutical R&D environment. You will define quality metrics, benchmarks, and governance across discovery, development, and operations, reporting to the GenAI leadership.

The role emphasizes building a team, collaborating with QMS/MLOps, and communicating complex findings to senior stakeholders.

Formación

• PhD required with 8+ years in pharma/biotech R&D.
• Hands-on experience with generative AI systems (LLMs, RAG, agentic frameworks).
• Proven track record designing evaluation frameworks, scientific benchmarks, or quality standards for AI/ML systems.

Responsabilidades

• Design evaluation frameworks for GenAI solutions covering quality, RAG, reliability, safety and scientific accuracy (across platforms).
• Lead vendor assessments with written evaluation reports and independent benchmarking.
• Governance and standards lead for GenAI quality; define production readiness and evaluation gates.
• Collaborate cross-functionally with QMS/MLOps, therapeutic area teams, and data strategy groups.
• Build and lead the GenAI Evaluation & Standards team, developing internal capability and governance.

Conocimientos

Advanced Analytics

Budget Management

Compliance Management

Critical Thinking

Data Analysis

Data Privacy Standards

Data Quality

Data Reporting

Data Savvy

Data Science

Data Visualization

Developing Others

Digital Fluency

Inclusive Leadership

Leadership

Program Management

Strategic Thinking

Succession Planning

Educación

PhD in computational biology, bioinformatics, data science, computer science, AI/ML, biomedical engineering, applied mathematics or related discipline

Descripción del empleo

Johnson & Johnson Innovation is seeking a senior leader for Data Analytics & Computational Sciences to establish the GenAI Evaluation & Standards function within a regulated pharmaceutical R&D environment. You will define quality metrics, benchmarks, and governance across discovery, development, and operations, reporting to the GenAI leadership.

The role emphasizes building a team, collaborating with QMS/MLOps, and communicating complex findings to senior stakeholders.