AI-Driven Test Framework Architect

Agilent Technologies; Santa Clara (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Result Bonus

Stock Purchase Plan

Life Insurance

Pension

Healthcare

Employee Assistance Program

Holidays

Company activities

Job summary

Agilent Technologies is seeking a Lead Test Framework Architect to lead AI adoption in our software test lifecycle and to build AI-driven test frameworks for a Kubernetes-based platform spanning instruments and applications.

The role is hands-on, senior, and focused on implementing automated testing controls in regulated environments (GxP, 21 CFR Part 11) while scaling across product teams and ensuring auditability and robust CI/CD gates.

Qualifications

• 10+ years of software engineering, with 3+ years in test architecture or quality engineering architecture roles.
• Hands-on use of AI-assisted development and testing tools (GitHub Copilot, Claude Code, Cursor, or equivalent).
• Deep Kubernetes expertise for test environment design: episodic namespace provisioning, container-based test infrastructure, environment-as-code.
• Strong experience designing multi-level test automation frameworks: unit, contract, integration, E2E, and performance testing in distributed systems.
• CI/CD pipeline architecture and quality gate integration (GitHub Actions, Jenkins, or equivalent).
• Contract testing experience (Pact or consumer-driven contract testing) for microservices and API-first architectures.
• Demonstrated ability to deliver reusable test frameworks adopted across multiple product teams.
• Working knowledge of testability-by-design and influence on architecture for testability.
• Experience leading adoption and change in an established engineering organization, with defensible outcome metrics.

Responsibilities

• Lead AI SDLC adoption for quality engineering. Own the strategy for AI-assisted test authoring, execution, triage, and maintenance.
• Build AI-native test frameworks. Design workflows that generate unit, contract, integration, and E2E suites from specifications and intent.
• Test our AI features. Build evaluation and regression frameworks for LLM- and agent-powered capabilities: non-deterministic evaluation, drift detection, AI observability.
• Own the regulatory bridge. Integrate AI-assisted testing into validated environments using risk-based CSA, GAMP 5 and IEC 62304.
• Establish human-in-the-loop governance with risk-scaled review checkpoints and rollback triggers.
• Define platform-wide test architecture standards for a Kubernetes-based microservices platform.
• Instrument and report on impact with DORA delivery metrics augmented by AI measures.

Skills

AI-assisted testing

Kubernetes

Contract testing

CI/CD pipelines

OpenTelemetry

Regulated validation

Tools

GitHub Copilot

Qodo

Diffblue

Playwright AI

Self-healing frameworks

Job description

Agilent Technologies is seeking a Lead Test Framework Architect to lead AI adoption in our software test lifecycle and to build AI-driven test frameworks for a Kubernetes-based platform spanning instruments and applications.

The role is hands-on, senior, and focused on implementing automated testing controls in regulated environments (GxP, 21 CFR Part 11) while scaling across product teams and ensuring auditability and robust CI/CD gates.