Test Engineer III

Heartflow; San Francisco (CA); On-site; USD 135,000 - 165,000; Full time

Job summary

Heartflow is seeking a Software Test Engineer to build and maintain automated end‑to‑end tests across UI, API, and backend services, under guidance from senior team members. You will apply AI‑assisted testing techniques, explore new tools, and contribute to test plans and documentation in a regulated SaMD environment.

You will implement UI automation with Selenium and Playwright, create API tests with REST Assured, Postman, Karate, Pact.io, and help ensure reliability in CI/CD pipelines,

Qualifications

• 3–5 years of experience in software test engineering, SDET, or quality engineering roles with a hands‑on automation focus.
• Genuine enthusiasm for AI‑assisted and emerging test automation tools and techniques; mindset and curiosity are valued.
• Experience testing SaMD or other regulated medical device software is preferred; strong candidates from other regulated environments will be considered.
• Familiarity with medical device QMS practices and standards (ISO 13485, IEC 62304, ISO 14971, 21 CFR Part 820).
• Proficiency with Selenium/WebDriver and Playwright, including writing stable UI automation.
• Hands‑on experience contributing to E2E automation suites and test frameworks.
• Experience authoring or maintaining test plans, protocols, and reports in a regulated environment.
• Practical use of AI‑assisted testing tools or strong motivation to ramp quickly.
• Solid programming skills in Python and/or TypeScript/Java/ C#; API testing tools experience.
• CI/CD systems familiarity (GitHub Actions, Jenkins, GitLab CI) and basic AWS exposure.

Responsibilities

• Build and maintain automated end‑to‑end tests across UI, API, and back‑end services under guidance.
• Explore AI‑assisted test automation techniques and propose new tools and approaches for team adoption.
• Perform post‑deployment verification activities including production smoke tests and CI/CD baseline tests.
• Contribute to test plans, protocols, and reports meeting QMS expectations.
• Participate in tool validation activities for test infrastructure and automation tooling.
• Implement and maintain UI test automation using Selenium and Playwright; improve framework patterns.
• Develop API‑level tests using REST Assured, Postman, Karate, Pact.io.
• Translate requirements into traceable test cases with engineers, product, RA/QA.
• Investigate test failures, file high‑quality defect reports, drive issues to resolution.
• Maintain automated tests in CI/CD and respond to pipeline breakages.
• Provide test evidence for audits, CAPAs, and regulatory submissions as needed.
• Partner with senior engineers to learn Heartflow’s ML pipeline and grow automation ownership.

Skills

Python

SDET mindset

AI-assisted testing

Debugging

Communication

Education

Bachelor’s degree in CS/Engineering

Tools

Selenium

Playwright

REST Assured

Postman

Karate

Pact.io

GitHub Actions

Jenkins

AWS

Job description

Heartflow is a medical technology company advancing the diagnosis and management of coronary artery disease, the #1 cause of death worldwide, using cutting‑edge technology.

The flagship product—an AI‑driven, non‑invasive cardiac test supported by the ACC/AHA Chest Pain Guidelines called the Heartflow FFRCT Analysis—provides a color‑coded, 3D model of a patient’s coronary arteries indicating the impact blockages have on blood flow to the heart.

Heartflow is the first AI‑driven non‑invasive integrated heart care solution across the CCTA pathway that helps clinicians identify stenoses in the coronary arteries (RoadMap™Analysis), assess coronary blood flow (FFRCT Analysis), and characterize and quantify coronary atherosclerosis (Plaque Analysis).

Our pipeline of products is growing and so is our team; join us in helping to revolutionize precision heartcare.

Heartflow is a publicly traded company (HTFL) that has received international recognition for exceptional strides in healthcare innovation, is supported by medical societies around the world, cleared for use in the US, UK, Europe, Japan and Canada, and has been used for more than 500,000 patients worldwide.

Responsibilities

• Build and maintain automated end‑to‑end (E2E) tests covering complete user workflows across UI, API, and back‑end services, under the technical direction of the Test Architect and Senior Test Engineer.
• Actively explore and apply AI‑assisted test automation techniques AI‑assisted authoring, self‑healing locators, generative test design, and AI‑supported triage and bring back recommendations on new tools and approaches worth adopting team‑wide.
• Execute post‑deployment verification activities such as production smoke tests and monitoring‑driven checks, including contributing to a new baseline of daily smoke tests across environments.
• Contribute to test plans, test protocols, and test reports under the guidance of senior engineers, ensuring documentation meets QMS expectations.
• Participate in tool validation activities for test infrastructure and automation tooling per internal procedures.
• Implement and maintain UI test automation using Selenium and Playwright; follow established framework patterns and contribute improvements and modernization ideas.
• Develop API‑level tests using tools such as REST Assured, Postman, Karate, Pact.io.
• Translate requirements and user stories into clear, traceable test cases in partnership with engineers, product, and RA/QA.
• Investigate test failures, file high‑quality defect reports, and partner with developers to drive issues to resolution.
• Help keep automated tests running reliably in CI/CD pipelines and respond promptly to pipeline breakages.
• Provide test evidence and documentation to support audits, CAPAs, and regulatory submissions as requested.
• Partner closely with the Test Architect and Senior Test Engineer to learn HeartFlow’s ML pipeline, clinical computation services, and Workstation/reporting systems, and grow into owning larger pieces of the automation strategy over time.

Qualifications

• 3–5 years of experience in software test engineering, SDET, or quality engineering roles, with a hands‑on automation focus.
• Genuine enthusiasm for AI‑assisted and emerging test automation tools and techniques, this role is as much about mindset and curiosity as it is about existing depth.
• Experience testing Software as a Medical Device (SaMD) or other regulated medical device software preferred; strong candidates from other regulated or quality‑critical environments will also be considered.
• Working familiarity with medical device QMS practices and applicable standards (e.g., ISO 13485, IEC 62304, ISO 14971, 21 CFR Part 820), including test documentation and traceability.
• Proficiency with Selenium / WebDriver and Playwright, including writing stable, maintainable UI automation.
• Hands‑on experience contributing to E2E automation suites and test frameworks.
• Exposure to authoring or maintaining test plans, protocols, and reports in a regulated environment.
• Practical use of AI‑assisted testing tools or techniques (e.g., AI‑augmented test authoring, self‑healing automation, LLM‑supported triage) or strong motivation and aptitude to ramp quickly.
• Solid programming skills in Python and/or another mainstream automation language (e.g., TypeScript/JavaScript, Java, or C#).
• Experience with API testing tools (REST Assured, Postman, Karate, Pact.io or equivalent).
• Familiarity with CI/CD systems (e.g., GitHub Actions, Jenkins, GitLab CI) and basic exposure to cloud environments such as AWS.
• Strong debugging skills and a structured approach to investigating failures.
• Clear written and verbal communication; able to document test designs and defects effectively, and to advocate for new tools and ideas within the team.
• Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Desired

• A track record of self‑directed learning side projects, open‑source contributions, or experimentation with new AI/testing tools.
• Exposure to RA/QA processes and supporting evidence collection for audits.
• Experience testing ML/AI features, clinical workflows, or medical imaging products.
• Experience validating visualizations such as 3D models, overlays, or measurement views.
• Familiarity with non‑functional / performance testing tools (e.g., k6, Locust, JMeter, Gatling).
• Exposure to data‑pipeline or microservices testing.

A reasonable estimate of the base salary compensation range is $135,000 to $165,000, bonus, and equity.

Heartflow is an Equal Opportunity Employer. We are committed to a work environment that supports, inspires, and respects all individuals and do not discriminate against any employee or applicant because of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law. This policy applies to every aspect of employment at Heartflow, including recruitment, hiring, training, relocation, promotion, and termination.

Positions posted for Heartflow are not intended for or open to third‑party recruiters / agencies. Submission of any unsolicited resumes for these positions will be considered to be free referrals.

Heartflow has become aware of a fraud where unknown entities are posing as Heartflow recruiters in an attempt to obtain personal information from individuals as part of our application or job offer process. Before providing any personal information to outside parties, please verify the following: A) all legitimate Heartflow recruiter email addresses end with “@heartflow.com” and B) the position described is found on our careers site at www.heartflow.com/about/careers/.