Test Engineer III

Heartflowinc; San Francisco (CA); On-site; USD 130,000 - 160,000; Full time

Job summary

Heartflowinc, based in San Francisco, seeks a Test Engineer III to advance test automation for its regulated medical products. This individual will be essential in applying AI-assisted techniques to enhance test coverage and maintain quality standards.

The ideal candidate has expertise in UI automation with frameworks like Selenium and Playwright, strong programming skills, and the ability to document processes effectively. Join Heartflow in revolutionizing heart care by contributing to high-quality medical technology.

Qualifications

• 3-5 years of experience in software test engineering with a hands-on automation focus.
• Experience testing Software as a Medical Device (SaMD) or regulated medical device software.
• Proficiency with test documentation and traceability in regulated environments.

Responsibilities

• Build and maintain automated E2E tests covering user workflows across UI, API, and back-end services.
• Execute post-deployment verification activities such as production smoke tests.
• Contribute to test plans, protocols, and reports under guidance of senior engineers.

Skills

UI automation frameworks (Selenium and Playwright)

API testing tools (REST Assured, Postman, Karate)

AI-assisted testing tools or techniques

Programming skills (TypeScript/JavaScript, Python, Java, C#)

Debugging skills

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Selenium/WebDriver

Playwright

CI/CD systems

Job description

Heartflow is a medical technology company advancing the diagnosis and management of coronary artery disease, the #1 cause of death worldwide, using cutting-edge technology. The flagship product - an AI-driven, non-invasive cardiac test supported by the ACC/AHA Chest Pain Guidelines called the Heartflow FFRCTAnalysis - provides a color-coded, 3D model of a patient’s coronary arteries indicating the impact blockages have on blood flow to the heart. Heartflow is the first AI-driven non-invasive integrated heart care solution across the CCTA pathway that helps clinicians identify stenoses in the coronary arteries (RoadMap™Analysis), assess coronary blood flow (FFRCTAnalysis), and characterize and quantify coronary atherosclerosis (Plaque Analysis). Our pipeline of products is growing and so is our team; join us in helping to revolutionize precision heartcare.

Heartflow is a publicly traded company (HTFL) that has received international recognition for exceptional strides in healthcare innovation, is supported by medical societies around the world, cleared for use in the US, UK, Europe, Japan and Canada, and has been used for more than 500000 patients worldwide.

The Test Engineer III is a hands‑on individual contributor on the Test Engineering team, responsible for executing and extending automated test coverage across our regulated SaMD products. This role focuses on end‑to‑end system testing and post‑deployment verification, contributing to test plans and tool validation activities under the guidance of senior engineers. The Test Engineer III applies an AI-first approach to test automation - using AI-assisted tooling to accelerate authoring and triage - while operating with the rigor required of a medical device QMS environment. The ideal candidate is comfortable with modern UI automation frameworks (Selenium and Playwright), eager to grow their depth in regulated software testing, and motivated to ship high-quality software that supports patient care.

Responsibilities

• Build and maintain automated end‑to‑end (E2E) tests covering complete user workflows across UI, API, and back‑end services.
• Apply AI-assisted test automation techniques - including AI-assisted authoring, self‑healing locators, and AI-supported triage - to expand coverage and reduce maintenance overhead.
• Execute post‑deployment verification activities such as production smoke tests and monitoring-driven checks.
• Contribute to test plans, test protocols, and test reports under the guidance of senior engineers, ensuring documentation meets QMS expectations.
• Participate in tool validation activities for test infrastructure and automation tooling per internal procedures.
• Implement and maintain UI test automation using Selenium, Vitest and Playwright; follow established framework patterns and contribute improvements.
• Develop API-level tests using tools such as REST Assured, Postman, or Karate.
• Translate requirements and user stories into clear, traceable test cases in partnership with engineers, product, and RA/QA.
• Investigate test failures, file high-quality defect reports, and partner with developers to drive issues to resolution.
• Help keep automated tests running reliably in CI/CD pipelines and respond promptly to pipeline breakages.
• Provide test evidence and documentation to support audits, CAPAs, and regulatory submissions as requested.

Qualifications

• 3-5 years of experience in software test engineering, SDET, or quality engineering roles, with a hands‑on automation focus.
• Experience testing Software as a Medical Device (SaMD) or other regulated medical device software.
• Working familiarity with medical device QMS practices and applicable standards (e.g., ISO 13485, IEC 62304, ISO 14971, 21 CFR Part 820), including test documentation and traceability.
• Proficiency with Selenium / WebDriver and Playwright, including writing stable, maintainable UI automation.
• Hands‑on experience contributing to E2E automation suites and test frameworks.
• Exposure to authoring or maintaining test plans, protocols, and reports in a regulated environment.
• Practical use of AI-assisted testing tools or techniques (e.g., AI-augmented test authoring, self‑healing automation, LLM-supported triage).
• Solid programming skills in at least one mainstream language used for automation (e.g., TypeScript/JavaScript, Python, Java, or C#).
• Experience with API testing tools (REST Assured, Postman, Karate, or equivalent).
• Familiarity with CI/CD systems (e.g., GitHub Actions, Jenkins, GitLab CI) and basic exposure to cloud environments such as AWS.
• Strong debugging skills and a structured approach to investigating failures.
• Clear written and verbal communication; able to document test designs and defects effectively.
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Desired

• Exposure to RA/QA processes and supporting evidence collection for audits.
• Experience testing ML/AI features, clinical workflows, or medical imaging products.
• Experience validating visualizations such as 3D models, overlays, or measurement views.
• Familiarity with non-functional / performance testing tools (e.g., k6, Locust, JMeter, Gatling).
• Exposure to data-pipeline or microservices testing.

A reasonable estimate of the base salary compensation range is $130000 to $160000, bonus, and equity. #LI-IB1

Heartflow is an Equal Opportunity Employer. We are committed to a work environment that supports, inspires, and respects all individuals and do not discriminate against any employee or applicant because of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law. This policy applies to every aspect of employment at Heartflow, including recruitment, hiring, training, relocation, promotion, and termination.

Positions posted for Heartflow are not intended for or open to third party recruiters / agencies. Submission of any unsolicited resumes for these positions will be considered to be free referrals.

Heartflow has become aware of a fraud where unknown entities are posing as Heartflow recruiters in an attempt to obtain personal information from individuals as part of our application or job offer process. Before providing any personal information to outside parties, please verify the following: A) all legitimate Heartflow recruiter email addresses end with @heartflow.com and B) the position described is found on our careers site at www.heartflow.com/about/careers/.