Senior Test Engineer

Jobtailor; San Francisco (CA); On-site; USD 140,000 - 180,000; Full time

Job summary

Jobtailor is seeking a seasoned Software Test Engineer to design, implement, and maintain end-to-end automated test suites across UI, API, and back-end services for regulated medical device software. You will champion an AI-driven testing strategy, scale coverage with AI-assisted authoring, and build daily smoke tests for development and staging environments.

You will lead post-deployment validation, develop golden-dataset regression tests for ML pipelines, and ensure test plans and reports meet

Qualifications

• 5-8 years of experience in software test engineering, SDET, or quality engineering roles, with a strong hands-on automation background.
• Direct experience testing Software as a Medical Device (SaMD) or other regulated medical device software.
• Working knowledge of medical device QMS practices and applicable standards (e.g., ISO 13485, IEC 62304, ISO 14971, 21 CFR Part 820), including test documentation, traceability, and tool validation.
• Strong proficiency with Selenium / WebDriver and Playwright, including framework design, page-object patterns, and stability/flake reduction techniques.
• Experience authoring test plans, protocols, and reports in a regulated environment, with attention to traceability between requirements, test cases, and evidence.
• Practical experience with AI-assisted testing tools and techniques (e.g., AI-augmented test authoring, self-healing automation, LLM-driven test generation or triage).
• Solid programming skills in Python and at least one additional mainstream language used for automation (e.g., TypeScript/JavaScript, Java, or C#).
• Experience with API testing tools (REST Assured, Postman, Karate, Pact.io or equivalent) and basic familiarity with contract testing concepts.
• Experience integrating automated tests into CI/CD pipelines (e.g., GitHub Actions, Harness) and working with cloud environments such as AWS.

Responsibilities

• Design, implement, and maintain end-to-end automated test suites across UI, API, and back-end services.
• Champion an AI-first automation strategy with AI-assisted test planning.
• Build daily smoke/build-acceptance tests for core workflows in development and staging environments.
• Lead post-deployment testing, including production smoke tests and monitoring-driven verification.
• Design golden-dataset regression tests for ML pipeline services.
• Build automated test coverage for UI/WebGL viewers and UIs using Playwright.
• Author clear, traceable test plans, protocols, and reports meeting QMS documentation standards.
• Perform tool validation for test infrastructure and automation tooling per internal QMS procedures.
• Build and maintain UI automation using Selenium and Playwright.
• Extend frameworks for stability, parallelism, and reuse across product lines.

Skills

Automation scripting

SDET mindset

Regulated environment

Tools

Selenium

Playwright

Python

REST Assured

Postman

Karate

Pact.io

GitHub Actions

AWS

Job description

• Design, implement, and maintain end-to-end (E2E) automated test suites that exercise complete user workflows across UI, API, and back-end services, executing against the architecture and standards set by the Test Architect.
• Champion an AI-first automation strategy. Implement and scale test coverage using AI-assisted authoring and generative test planning derived from AI-generated requirements, while leveraging intelligent triage to minimize maintenance overhead.
• Build and own a baseline suite of daily smoke/build-acceptance tests covering core workflows across development and staging environments, closing a current gap where automated testing only runs during formal V&V cycles.
• Lead post-deployment testing activities, including production smoke tests, monitoring-driven verification, and continuous validation against live environments.
• Design and implement golden-dataset regression tests for HeartFlow's ML pipeline services, validating algorithmic outputs against curated reference cases.
• Build automated test coverage for HeartFlow's WebGL-based 3D Web Viewer and Clinical/CaseOps UIs using Playwright, including visual regression for 3D model rendering and view generation.
• Author clear, traceable test plans, test protocols, and test reports that meet the documentation expectations of a regulated medical device QMS.
• Perform tool validation for test infrastructure and automation tooling in accordance with internal QMS procedures and applicable standards.
• Build and maintain UI automation using Selenium and Playwright
• extend frameworks for stability, parallelism, and reuse across product lines.

Requirements

• 5-8 years of experience in software test engineering, SDET, or quality engineering roles, with a strong hands-on automation background.
• Required: Direct experience testing Software as a Medical Device (SaMD) or other regulated medical device software.
• Required: Working knowledge of medical device QMS practices and applicable standards (e.g., ISO 13485, IEC 62304, ISO 14971, 21 CFR Part 820), including test documentation, traceability, and tool validation.
• Required: Strong proficiency with Selenium / WebDriver and Playwright, including framework design, page-object patterns, and stability/flake reduction techniques.
• Demonstrated experience designing and maintaining E2E automation frameworks that cover complete workflows and system integrations.
• Experience authoring test plans, protocols, and reports in a regulated environment, with attention to traceability between requirements, test cases, and evidence.
• Practical experience with AI-assisted testing tools and techniques (e.g., AI-augmented test authoring, self-healing automation, LLM-driven test generation or triage).
• Solid programming skills in Python and at least one additional mainstream language used for automation (e.g., TypeScript/JavaScript, Java, or C#).
• Experience with API testing tools (REST Assured, Postman, Karate, Pact.io or equivalent) and basic familiarity with contract testing concepts.
• Experience integrating automated tests into CI/CD pipelines (e.g., GitHub Actions, Harness) and working with cloud environments such as AWS.

Core Competencies

Candidates should emphasize their expertise in designing and implementing automated testing frameworks, particularly in regulated medical device environments. Highlighting experience with AI-assisted testing tools, strong programming skills, and proficiency in automation tools like Selenium and Playwright will be crucial for success in this role.

Highest-signal resume keywords

• Experience in Software Test Engineering
• Direct experience with Software as a Medical Device (SaMD)
• Strong proficiency with Selenium and Playwright
• Working knowledge of medical device QMS practices
• Experience with AI-assisted testing tools

ATS Optimization Keywords

Hard Skills

• Automated Testing
• End-to-End (E2E) Testing
• Selenium
• Playwright
• Python
• API Testing
• CI/CD Integration
• Test Documentation
• Framework Design
• AI-Augmented Test Authoring

Soft Skills

• Attention to Detail
• Clear Communication
• Problem Solving
• Collaboration
• Adaptability

Certifications & Qualifications

• ISO 13485
• IEC 62304
• ISO 14971
• 21 CFR Part 820

Industry Keywords

• Software as a Medical Device (SaMD)
• Regulated Medical Device Software
• Quality Management System (QMS)
• Test Documentation
• Traceability

Tools & Technologies

• REST Assured
• Postman
• GitHub Actions
• AWS
• Karate
• Pact.io