Senior Director, Testing & Quality Engineering - Evinova

Evinova; Boston (MA); On-site; USD 203,000 - 305,000; Full time

Job summary

Evinova is building a unified testing function to drive quality across its health-tech portfolio. This hands-on role leads director-level testing leads, sets standards, and advances automation while embracing AI-enabled testing in a regulated software environment.

You will partner across engineering, product, and delivery to ship high-quality trials software, embedding quality as a core capability and sustaining momentum across multiple products with competing priorities.

Qualifications

• 8+ years in quality engineering, software engineering, or product engineering, with at least 3 years leading a quality or testing function at senior level.
• Proven track record building test automation programs from low maturity — not inheriting finished ones
• Demonstrated ability to consolidate fragmented testing functions across multiple teams, supporting multiple products with competing priorities
• Knowledge of GxP and requirements traceability in a regulated software environment
• Hands-on experience with modern test automation frameworks and CI/CD integration — you have done this, not just overseen it
• Experience defining or operating evaluation frameworks for AI/ML features in production, or a demonstrable track record of building new technical practices from scratch

Responsibilities

• Build and lead the testing function by consolidating distributed teams into a unified unit.
• Define GA-readiness across the product portfolio and enforce standards.
• Drive automation strategy, CI/CD integration, and coverage metrics across products.
• Establish traceability infrastructure under GxP and ensure audit readiness.
• Define AI evaluation practices and embed AI capabilities into testing workflows.
• Embed quality early in delivery by partnering across engineering, product, and delivery teams.
• Define and own quality metrics and use data to drive decisions.

Education

Bachelor’s Degree in Engineering, Computer Science, or equivalent

Job description

Are you ready to be part of the future of healthcare? Can you think big, be bold, and harness the power of digital and AI to tackle one of the most stubborn problems in regulated software engineering — knowing, with confidence, that what you shipped works? Then Evinova, a health tech business part of the AstraZeneca Group, might be for you.

We are building software that transforms clinical trials. Evinova delivers market-leading digital health solutions that are science-based, evidence-led, and human experience-driven. Quality is not a gate at the end of our process — it is embedded in everything we build.

About Our Engineering Organization

Our Product Engineering organization consists of cross-functional squads with the people and skills needed to deliver innovative digital products to patients and healthcare providers in clinical trials worldwide.

We are proud to have one of the strongest software development teams in the health tech space. This is a place where you build real things, solve hard problems, and grow alongside engineers who care deeply about their craft and its impact on patients.

About The Role

This is not a steady-state management role. We are looking for a hands‑on testing leader who can consolidate a distributed testing function that has not succeeded as a distributed model, build it into a coherent high‑performing organization, and run it — all at the same time.

You will bring together testing teams currently embedded across squads and products into a single function with unified leadership, standards, tooling, and automation maturity. You will own the quality engineering capability across Evinova’s full product portfolio — driving speed, alignment with delivery teams, and a step‑change in automation coverage and AI‑assisted testing.

You will establish the leadership layer beneath you — Director‑Level testing leads who own delivery accountability and validation processes within each product area. You will define what GA‑readiness means across the portfolio and hold the line on it. If it hasn’t passed your function’s bar, it doesn’t ship.

We expect you to be the strongest quality engineering voice in the room — someone who can challenge a release decision, close a coverage gap before it becomes a customer issue, and build the testing function the organization does not yet have. You will support multiple products with competing priorities and be effective at managing the complexity that creates. This is not a role for someone who has studied multi‑product quality leadership — it is a role for someone who has done it, made hard calls under pressure, and has the experience and judgment that only comes from having done it at scale.

Key Responsibilities

• Building and Leading the Testing Function: Consolidate testing teams currently distributed across squads and products into a unified function. Establish the leadership layer beneath you — Director‑Level testing leads who own delivery accountability and validation processes within each product area. Define the org structure, set the standard, and build it while running it.


• Defining What “Done” Means: Own the standards that define GA‑readiness across Evinova’s product portfolio. Drive alignment with engineering, product, and quality on what testable and shippable actually means — and hold the line on it across all products.


• Driving Test Automation: Own the shift from manual to automated functional testing across the portfolio. Set the automation roadmap. Make framework and tooling decisions. Work directly in test pipelines, CI/CD configurations, and coverage metrics. Progress across coverage, automation maturity, quality of testing, and quality of release are the primary measures of success in this role.


• Owning Traceability and Audit Readiness: Establish and maintain the requirements‑to‑test traceability infrastructure required under GxP frameworks. Traceability is not a compliance checkbox — it is the evidence that our products actually do what they say they will do.


• Building the AI Evaluation Practice: Define how AI capabilities embedded in Evinova products are tested at release and monitored in production. Build the eval frameworks, model regression testing and output validation approaches, and documentation standards that allow AI features to meet the same audit bar as everything else we ship. Our desired outcome is evaluation frameworks that include human review checkpoints — not just automated scoring.


• Embedding AI Into the Testing Workflow: Use AI tooling to make your function faster and smarter — automated test generation, intelligent coverage analysis, AI‑assisted QA workflows. Model the standard you expect from the org.


• Defining and Owning Quality Metrics: Establish the metrics framework that makes quality visible across engineering, product, and leadership. Define what we measure, track progress over time, and use data to drive decisions — on automation coverage, defect trends, release quality, and AI evaluation outcomes.


• Partnering Across Engineering, Product, Quality, and Delivery: Work across squads and functions to embed quality earlier in the delivery process. Reduce rework. Improve release confidence. Position quality engineering as an accelerant, not a bottleneck.

Minimum Qualifications

• 8+ years in quality engineering, software engineering, or product engineering, with at least 3 years leading a quality or testing function at senior level


• Proven track record building test automation programs from low maturity — not inheriting finished ones


• Demonstrated ability to consolidate fragmented testing functions across multiple teams, supporting multiple products with competing priorities


• Knowledge of GxP and requirements traceability in a regulated software environment


• Hands‑on experience with modern test automation frameworks and CI/CD integration — you have done this, not just overseen it


• Experience defining or operating evaluation frameworks for AI/ML features in production, or a demonstrable track record of building new technical practices from scratch


• Bachelor’s Degree in Engineering, Computer Science, or equivalent demonstrated through professional experience

Desired Qualifications

• Experience with electronic Clinical Outcome Assessments (eCOA), patient‑facing clinical trial software, or similar regulated healthtech


• Hands‑on experience with LLM evaluation frameworks, model monitoring, or agentic AI quality practices


• Familiarity with ALCOA+ data integrity principles in a regulated software environment


• Clinical research domain knowledge

What This Role Is Not

• A pure people‑management position where quality engineering runs itself and you attend the meetings. If you haven’t been in the detail of a test architecture or automation pipeline in the past quarter, this role is not the right fit.


• A compliance function that writes documentation after engineering has finished. You are a builder, embedded in delivery, not an auditor reviewing the output.


• A tools and test automation specialist who optimises frameworks in isolation from delivery. This role requires someone who understands what is in flight across the full portfolio, balances the theoretical best tool with the reality on the ground, and has led complicated quality engineering organisations across multiple products simultaneously — not just described how they would.


• A checkbox exercise in AI adoption. We need someone who has genuinely transformed their own quality engineering workflow with AI tools and can credibly lead the organization to do the same.

When we put unexpected teams in the same room, we unleash bold thinking with the power to encourage life‑changing medicines. In‑person working gives us the platform we need to connect, work at pace and challenge perceptions. That’s why we work, on average, a minimum of three days per week from the office. But that doesn’t mean we’re not flexible. We balance the expectation of being in the office while respecting individual flexibility. Join us in our unique and ambitious world.

The annual base pay for this position ranges from $203,213.60 - $304,820.40 USD Annual. Hourly and salaried non‑exempt employees will also be paid overtime pay when working qualifying overtime hours. Base pay offered may vary depending on multiple individualized factors, including market location, job‑related knowledge, skills, and experience. In addition, our positions offer a short‑term incentive bonus opportunity; eligibility to participate in our equity‑based long‑term incentive program (salaried roles), to receive a retirement contribution (hourly roles), and commission payment eligibility (sales roles). Benefits offered included a qualified retirement program [401(k) plan]; paid vacation and holidays; paid leaves; and, health benefits including medical, prescription drug, dental, and vision coverage in accordance with the terms and conditions of the applicable plans. Additional details of participation in these benefit plans will be provided if an employee receives an offer of employment. If hired, employee will be in an “at‑will position” and the Company reserves the right to modify base pay (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.

Why Evinova (AstraZeneca)?

Evinova draws on AstraZeneca’s deep experience developing novel therapeutics, informed by insights from thousands of patients and clinical researchers. Together, we accelerate the delivery of life‑changing medicines and improve the design and delivery of clinical trials. By bringing our solutions to the wider healthcare community, we help build unified approaches to digital technology in life sciences.

Join us on our journey of building a new kind of health tech business to reset expectations of what a bio‑pharmaceutical company can be.

Date Posted

30-Oct-2026

Closing Date

Our mission is to build an inclusive environment where equal employment opportunities are available to all applicants and employees. In furtherance of that mission, we welcome and consider applications from all qualified candidates, regardless of their protected characteristics. If you have a disability or special need that requires accommodation, please complete the corresponding section in the application form.