Lead Test Framework Architect (M/F/D)

Agilent; Barcelona; On-site; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Stock Purchase Plan

Healthcare

Life Insurance

Pension

Holiday

Job summary

Agilent seeks a Lead Test Framework Architect to own AI‑driven test frameworks for a Kubernetes‑based software platform spanning instruments and applications. You will drive AI SDLC adoption, design AI‑assisted test authoring and evaluation, and scale reference workflows across product teams while maintaining regulatory compliance in GxP/21 CFR Part 11 contexts.

You will build AI‑native test frameworks, integrate Copilot and other tools into CI/CD gates, and establish governance for AI‑generated

Qualifications

• 10+ years in software engineering with 3+ years in test architecture.
• Hands-on use of AI-assisted development/testing tools; able to discuss usage patterns and failures.
• Deep Kubernetes expertise for test environments: ephemeral namespaces, container tests, infra as code.
• Strong in multi-level test automation: unit, contract, integration, E2E, and performance tests.
• Experience integrating CI/CD quality gates (GitHub Actions/Jenkins).
• Contract testing experience for microservices and API-first architectures.
• Deliver reusable test frameworks across product teams; more than guidelines.
• Influence to make software more testable by design; lead adoption in org.
• Track record of defensible outcome metrics during change initiatives.

Responsibilities

• Lead AI SDLC adoption for quality engineering.
• Own AI-assisted test authoring, execution, triage, and maintenance strategy.
• Scale reference workflows across product teams; prove value.
• Build AI-native test frameworks; ensure tests reflect intended behavior.
• Design workflows to generate unit/contract/integration/E2E suites from specs.
• Verify AI-generated tests match intent, not implementation details.
• Integrate Copilot and other tools into CI/CD gates.
• Build evaluation/regression frameworks for LLM/agent capabilities.
• Own regulatory bridge; align with CSA/CSV and IEC 62304 where relevant.
• Preserve audit trails and data integrity for AI artifacts.
• Establish human-in-the-loop governance; define risk review checkpoints.

Skills

AI‑assisted testing

Kubernetes test architecture

CI/CD quality gates

Test automation frameworks

Regulated software validation

DL/LLM evaluation

Change leadership

Testability‑by‑design

Contract testing

Regulatory standards mapping

Tools

GitHub Copilot

Claude Code

Cursor

Diffblue

Playwright AI

Qodo

Job description

Job Description

Agilent is building a Kubernetes-based software platform spanning instruments, applications, and shared services across multiple product lines, while embedding AI into how we build and verify that software. That software runs instruments used in over 265,000 labs worldwide, supporting work like R&D, cancer diagnostics, and food and water safety testing. We’re looking for a Lead Test Framework Architect to own the test frameworks, evaluation methods, and governance that let us ship AI-accelerated software safely in regulated GxP / 21 CFR Part 11 environments. That calls for someone who already has hands‑on, proven depth in Kubernetes test environment architecture, AI and LLM evaluation frameworks, and regulated software validation. AI accelerates software delivery, but that acceleration exposes weaknesses downstream without a strong automated-testing control system. You'll build that control system and lead the organization in adopting it.

Responsibilities

• Lead AI SDLC adoption for quality engineering.
• Own the strategy for AI‑assisted test authoring, execution, triage, and maintenance.
• Prove value through reference workflows, then scale adoption across product teams.
• Build AI‑native test frameworks.
• Design workflows that generate unit, contract, integration, and E2E suites from specifications and intent.
• Verify that AI‑generated tests exercise specified intent, not implementation.
• Integrate GitHub Copilot (enterprise standard) and complementary tools (e.g., Qodo, Diffblue, Playwright AI agents, self‑healing frameworks) into CI/CD quality gates.
• Test our AI features.
• Build evaluation and regression frameworks for LLM‑ and agent‑powered product capabilities: non‑deterministic evaluation, hallucination and grounding scoring, drift detection, and AI observability using OpenTelemetry GenAI conventions.
• Own the regulatory bridge.
• Integrate AI‑assisted testing into validated environments using risk‑based Computer Software Assurance (CSA), GAMP 5 (2nd Edition) and the ISPE GAMP AI Guide, and - for diagnostics software - IEC 62304.
• Preserve audit trails, traceability, and data integrity for AI‑generated artifacts.
• Establish human‑in‑the‑loop governance.
• Define risk‑scaled review checkpoints, acceptance criteria, and rollback triggers for AI‑generated code and tests.
• Define platform‑wide test architecture standards for a Kubernetes‑based microservices platform: testability‑by‑design, test environment strategy (ephemeral namespaces, environment‑as‑code), CI/CD quality gate architecture, contract testing for microservices and APIs, test data strategy (synthetic data, isolation, AI/ML data requirements), and E2E frameworks that work reliably in containerized environments.
• Instrument and report on impact.
• DORA delivery metrics augmented with AI‑specific measures (coverage delta, defect‑escape rate, mean‑time‑to‑triage, eval‑suite pass rates).
• Lead the change effort - champions, enablement, playbooks - that drives durable adoption.

Qualifications Required

• 10+ years of software engineering, with 3+ years in test architecture or quality engineering architecture roles.
• Demonstrated daily, hands‑on use of AI‑assisted development and testing tools (GitHub Copilot, Claude Code, Cursor, or equivalent) with the ability to speak concretely to effective usage patterns and failure modes.
• Deep hands‑on Kubernetes expertise for test environment design: ephemernal namespace provisioning, container‑based test infrastructure, environment‑as‑code.
• Strong experience designing multi‑level test automation frameworks: unit, contract, integration, E2E, and performance testing in distributed systems.
• CI/CD pipeline architecture and quality gate integration (GitHub Actions, Jenkins, or equivalent).
• Contract testing experience (Pact or consumer‑driven contract testing) for microservices and API‑first architectures.
• Demonstrated ability to deliver reusable test frameworks adopted across multiple product teams — reference implementations, not just guidelines.
• Working knowledge of testability‑by‑design and the ability to influence how software is architected to be inherently more testable.
• Experience leading adoption and change in an established engineering organization, with a track record of defensible outcome metrics.

Preferred Experience

• Testing AI/ML, LLM, or agent‑based systems: evaluation frameworks (deepeval, promptfoo, LangSmith, Langfuse, Maxim AI, or equivalent), non‑deterministic regression, hallucination and grounding scoring, drift detection.
• Fluency in regulated software validation: 21 CFR Part 11, GxP / GAMP 5, CSA vs. CSV, and IEC 62304 for medical device or diagnostics software.
• Context engineering for LLMs: prompt/spec design, RAG, MCP servers, project‑memory patterns.
• Observability tooling in containerized environments, ideally with OpenTelemetry GenAI Semantic Conventions.
• Performance and load testing at platform scale (k6, Gatling, Locust, or equivalent).
• Infrastructure‑as‑code and GitOps applied to test environment provisioning.
• Background in scientific instrument software, laboratory platforms, or life sciences / diagnostics.

We offer (depending on the country you are based in): An independent job in collaboration with good colleagues, in a growth‑orientated organization A true commitment to work/life balance An opportunity to learn and grow

Benefits

• Agilent Result Bonus
• Stock Purchase Plan
• Life Insurance
• Pension
• Healthcare
• Employee Assistance Program
• Holiday
• Company activities

Additional Details This job has a full time weekly schedule. Our pay ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job‑related skills, experience, and relevant education or training. During the hiring process, a recruiter can share more about the specific pay range for a preferred location. Pay and benefit information by country are available at: https://careers.agilent.com/locations

Agilent Technologies Inc. is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other protected categories under all applicable laws.

Travel Required: 25% of the Time Shift: Day Duration: No End Date Job Function: R&D

As a global leader in laboratory and clinical technologies, we are passionate about bringing great science to life. Our commitment to quality and innovation supports cutting‑edge life science research, patient diagnostics, and ensures the safety of water, food, and pharmaceuticals. As scientists and clinicians pursue small, everyday advances and life‑changing discoveries, we provide trusted answers to their most critical questions and challenges. Leveraging more than 50 years of expertise, we create advanced instruments, software, and consumables supported by teams of highly skilled and knowledgeable people. With 18,000 employees around the world, our global reach and comprehensive solutions provide the most reliable and accurate results, as well as optimal scientific, economic, and operational outcomes. We work collaboratively with our customers on their journey to make a real difference in human lives. Our culture is founded on trust, respect, and uncompromising integrity, and we pride ourselves on being a dynamic and inclusive workplace that celebrates diversity and fosters innovation. We can’t wait for you to join us as we continue our mission to improve the world around us. Information about Agilent is available at Agilent.com.