Lead Test Framework Architect (M/F/D)

Agilent

España

Presencial

EUR 110.000 - 140.000

Jornada completa

14 días+

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Agilent seeks a Lead Test Framework Architect to drive AI-enabled testing across a Kubernetes-based software platform for instruments, applications, and shared services. You will design AI-assisted test authoring, governance, and evaluation, embedding observability and risk controls in regulated environments.

You will lead adoption, build AI-native test frameworks, and ensure tests reflect intended behavior while protecting data integrity and auditability.

Formación

  • 10+ years of software engineering, with 3+ years in test architecture or quality engineering architecture roles.
  • Hands-on use of AI-assisted development and testing tools with concrete usage patterns and failure modes.
  • Deep hands-on Kubernetes expertise for test environment design: ephemeral namespace provisioning, container-based test infrastructure.
  • Strong experience designing multi-level test automation frameworks: unit, contract, integration, E2E, and performance testing in distributed systems.
  • CI/CD pipeline architecture and quality gate integration (GitHub Actions, Jenkins, or equivalent).
  • Contract testing experience (Pact or consumer-driven contract testing) for microservices and API-first architectures.
  • Demonstrated ability to deliver reusable test frameworks adopted across multiple product teams.
  • Working knowledge of testability-by-design and ability to influence architecture to be inherently more testable.

Responsabilidades

  • Lead AI SDLC adoption for quality engineering and define strategy for AI-assisted test authoring, execution, triage, and maintenance.
  • Build AI-native test frameworks and integrate Copilot and complementary tools into CI/CD quality gates.
  • Test AI features with evaluation and regression frameworks: non-deterministic evaluation, drift detection, and AI observability.
  • Own regulatory bridge: integrate AI testing into validated environments with CSA, GAMP 5, and IEC 62304. Preserve audit trails and data integrity.
  • Establish human-in-the-loop governance with risk-scaled review checkpoints and rollback triggers.
  • Define platform-wide test architecture standards for a Kubernetes-based microservices platform.
  • Instrument and report on impact using DORA metrics plus AI-specific measures and drive durable adoption.

Conocimientos

AI testing
Kubernetes
CI/CD
Contract testing
Test automation
Change management
Compliance

Herramientas

GitHub Copilot
Diffblue
Playwright AI
OpenTelemetry
Self-healing frameworks

Descripción del empleo

Job Description

Agilent is building a Kubernetes-based software platform spanning instruments, applications, and shared services across multiple product lines. We are embedding AI into how we build and verify software. We are looking for a Lead Test Framework Architect to lead the adoption of AI in our software test lifecycle, and to build the test frameworks, evaluation methods, and governance that let us ship AI-accelerated software safely in regulated, GxP / 21 CFR Part 11 environments.

This is a hands-on senior individual-contributor role. AI accelerates software delivery, but that acceleration exposes weaknesses downstream without a strong automated-testing control system. Building that control system - and leading the organization to adopt it - is the core of this role.

Responsibilities
  • Lead AI SDLC adoption for quality engineering. Own the strategy for AI-assisted test authoring, execution, triage, and maintenance. Prove value through reference workflows, then scale adoption across product teams.
  • Build AI-native test frameworks. Design workflows that generate unit, contract, integration, and E2E suites from specifications and intent. Verify that AI-generated tests exercise specified intent, not implementation. Integrate GitHub Copilot (enterprise standard) and complementary tools (e.g., Qodo, Diffblue, Playwright AI agents, self-healing frameworks) into CI/CD quality gates.
  • Test our AI features. Build evaluation and regression frameworks for LLM- and agent-powered product capabilities: non-deterministic evaluation, hallucination and grounding scoring, drift detection, and AI observability using OpenTelemetry GenAI conventions.
  • Own the regulatory bridge. Integrate AI-assisted testing into validated environments using risk-based Computer Software Assurance (CSA), GAMP 5 (2nd Edition) and the ISPE GAMP AI Guide, and - for diagnostics software - IEC 62304. Preserve audit trails, traceability, and data integrity for AI-generated artifacts.
  • Establish human-in-the-loop governance. Define risk-scaled review checkpoints, acceptance criteria, and rollback triggers for AI-generated code and tests.
  • Define platform-wide test architecture standards for a Kubernetes-based microservices platform: testability-by-design, test environment strategy (ephemeral namespaces, environment-as-code), CI/CD quality gate architecture, contract testing for microservices and APIs, test data strategy (synthetic data, isolation, AI/ML data requirements), and E2E frameworks that work reliably in containerized environments.
  • Instrument and report on impact. DORA delivery metrics augmented with AI-specific measures (coverage delta, defect-escape rate, mean-time-to-triage, eval-suite pass rates). Lead the change effort - champions, enablement, playbooks - that drives durable adoption.
Qualifications
Required
  • 10+ years of software engineering, with 3+ years in test architecture or quality engineering architecture roles.
  • Demonstrated daily, hands-on use of AI-assisted development and testing tools (GitHub Copilot, Claude Code, Cursor, or equivalent) with the ability to speak concretely to effective usage patterns and failure modes.
  • Deep hands-on Kubernetes expertise for test environment design: ephemeral namespace provisioning, container-based test infrastructure, environment-as-code.
  • Strong experience designing multi-level test automation frameworks: unit, contract, integration, E2E, and performance testing in distributed systems.
  • CI/CD pipeline architecture and quality gate integration (GitHub Actions, Jenkins, or equivalent).
  • Contract testing experience (Pact or consumer-driven contract testing) for microservices and API-first architectures.
  • Demonstrated ability to deliver reusable test frameworks adopted across multiple product teams - reference implementations, not just guidelines.
  • Working knowledge of testability-by-design and the ability to influence how software is architected to be inherently more testable.
  • Experience leading adoption and change in an established engineering organization, with a track record of defensible outcome metrics.
Preferred
  • Experience testing AI/ML, LLM, or agent-based systems: evaluation frameworks (deepeval, promptfoo, LangSmith, Langfuse, Maxim AI, or equivalent), non-deterministic regression, hallucination and grounding scoring, drift detection.
  • Fluency in regulated software validation: 21 CFR Part 11, GxP / GAMP 5, CSA vs. CSV, and IEC 62304 for medical device or diagnostics software.
  • Context engineering for LLMs: prompt/spec design, RAG, MCP servers, project-memory patterns.
  • Observability tooling in containerized environments, ideally with OpenTelemetry GenAI Semantic Conventions.
  • Performance and load testing at platform scale (k6, Gatling, Locust, or equivalent).
  • Infrastructure-as-code and GitOps applied to test environment provisioning.
  • Background in scientific instrument software, laboratory platforms, or life sciences / diagnostics.
We offer (depending on the country you are based in)

An in

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Lead Test Framework Architect (M/F/D)
Lead Test Framework Architect (M/F/D)

Agilent Technologies, Inc. • Barcelona

Presencial
EUR 110.000 - 150.000
Independent job in collaboration with/
Work-life balance
Opportunity to learn and grow
+1
Lead Test Framework Architect (M/F/D)
Lead Test Framework Architect (M/F/D)

Agilent • Barcelona

Presencial
EUR 90.000 - 130.000
Stock Purchase Plan
Healthcare
Life Insurance
+2
Lead AI Test Framework Architect (Kubernetes & Regulated AI)
Lead AI Test Framework Architect (Kubernetes & Regulated AI)

Agilent • Barcelona

Presencial
EUR 90.000 - 130.000
Stock Purchase Plan
Healthcare
Life Insurance
+2
AI Test Automation Engineer 100% (f/m/d)
AI Test Automation Engineer 100% (f/m/d)

Juliusbaer • Madrid

Presencial
EUR 60.000 - 100.000
Lead AI-Driven Test Framework Architect (Kubernetes)
Lead AI-Driven Test Framework Architect (Kubernetes)

Agilent Technologies, Inc. • Barcelona

Presencial
EUR 110.000 - 150.000
Independent job in collaboration with/
Work-life balance
Opportunity to learn and grow
+1
Senior QA Test Automation Engineer
Senior QA Test Automation Engineer

Dematic Corp. (ILD-US) • Barcelona

Híbrido
EUR 70.000 - 95.000
Private health insurance
Food Allowance
Hybrid Work Model
+2
AI Engineer - AI SDLC Tooling & Guardrails
AI Engineer - AI SDLC Tooling & Guardrails

SIX • Las Rozas de Madrid

Híbrido
EUR 70.000 - 110.000
AI Lead
AI Lead

Applus+ Laboratories • Cerdanyola del Vallés

Presencial
EUR 90.000 - 140.000
AI-Driven Test Framework Architect for Regulated Systems
AI-Driven Test Framework Architect for Regulated Systems

Agilent • España

Presencial
EUR 110.000 - 140.000
QA Engineer | Barcelona
QA Engineer | Barcelona

TransPerfect Translations International • Barcelona

Presencial
EUR 42.000 - 64.000