Senior Test Automation Engineer

Radai

San Francisco (CA)

On-site

USD 140,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Rad AI is seeking a skilled QA Automation Engineer to own test automation strategy, design scalable frameworks, and drive quality across radiology-focused AI products. You will mentor teams, lead performance tests, and ensure robust CI/CD integration while validating non-deterministic AI outputs in clinical workflows.

Join a mission-driven company shaping healthcare AI, with a strong emphasis on reliability, HIPAA-compliant processes, and collaboration with engineers and radiologists.

Qualifications

  • 6+ years of software engineering or test automation experience.
  • 3+ years designing and owning automation frameworks.
  • Strong programming skills in TypeScript and/or Python; OO language such as C# or Java a plus.
  • Deep experience with end-to-end frameworks such as Playwright, Selenium, or Cypress.
  • API testing across REST and GraphQL; tests interact with data and dependencies.
  • Experience building tests into CI/CD pipelines (GitHub Actions or CircleCI).

Responsibilities

  • Own test automation strategy for your domain. Decide what to test, at which level, and why, across complex features and the teams that build them. Balance short-term delivery with the long-term health of our test suites.
  • Design automation others build on. Build scalable, maintainable frameworks, fixtures, and utilities that engineers use to write their own tests. Partner with engineers to improve testability, and use AI-assisted test generation where it raises quality and speed.
  • Make release risk explicit. Run pre-release risk assessments, build the test matrix across integrations, environments, and customer workflows, and lead test planning for high-risk releases and hotfixes. Help define the go/no-go signals your domain ships on.
  • Test the way radiologists work. Turn radiologist personas and real workflows into test cases. Bring customer-matched environments into validation, such as Windows and Electron workstations, dictation systems, and PACS/RIS integrations, and use exploratory testing where automation falls short.
  • Keep the test signal trustworthy. Drive down flaky and low-signal tests, triage failures quickly, cut suite execution time, and improve test data and environment stability with our platform teams.
  • Lead non-functional quality in your domain. Lead or co-lead performance and load testing, security checks in pipelines, and accessibility and compliance coverage such as HIPAA-related auditability.
  • Test AI systems responsibly. Design evaluations for non-deterministic outputs, such as speech recognition and generated impressions, that don't hinge on a single result.
  • Turn escaped defects into prevention. Use incident reviews and customer-reported defects to add regression coverage and update risk profiles, so the same failure doesn't reach a radiologist twice.
  • Use data to guide decisions. Track escaped defects, test stability, and time to detect for your domain, and keep suites organized in our test case management system so results are visible and comparable.
  • Raise the bar around you. Mentor TAEs and software engineers across teams, act as a trusted quality partner to Engineering Managers on risk and release readiness, and contribute to hiring, onboarding, and our Quality community.

Skills

TypeScript
Python
C# or Java
Playwright
Selenium
Cypress
API testing
CI/CD

Tools

Playwright
Selenium
Cypress

Job description

ABOUT RAD AI At Rad AI, we’re on a mission to transform healthcare with artificial intelligence. Founded by a radiologist, our AI-driven solutions are revolutionizing radiology—saving time, reducing burnout, and improving patient care. With one of the largest proprietary radiology report datasets in the world, our AI has helped uncover hundreds of new cancer diagnoses and reduced error rates in tens of millions of radiology reports by nearly 50%. Rad AI has secured over $140M in funding, including a recently oversubscribed Series C ($68M round) led by Transformation Capital, bringing our valuation to $528M. Our investors include Khosla Ventures, World Innovation Lab, Gradient Ventures, Cone Health Ventures, and others—all backing our mission to empower physicians with cutting-edge AI. Our latest advancements in generative AI are used by thousands of radiologists daily, supporting more than one-third of radiology groups and healthcare systems and nearly 50% of all medical imaging in the U.S. at partners including Cone Health, Jefferson Einstein Health, Geisinger, Guthrie Healthcare System, and Henry Ford Health. Recognized as one of the most promising healthcare AI companies by CB Insights and AuntMinnie https://www.radai.com/news/auntminnie-recognizes-rad-ai-omni-reporting-as-2023s-best-new-radiology-software, and ranked by Deloitte https://www2.deloitte.com/us/en/pages/technology-media-and-telecommunications/articles/fast500-winners.html as the 19th fastest-growing company in North America, we are building AI-powered solutions that make a real impact. Most recently, Rad AI was named to CNBC’s Disruptor 50 https://www.cnbc.com/2025/06/10/2025-cnbc-disruptor-50-see-the-full-list-of-companies.html list, highlighting the innovation and momentum behind our mission. If you’re ready to shape the future of healthcare, we’d love to have you on our team!

WHY WE NEED YOU

Radiologists use our products every day to produce the reports that decide what care a patient gets next. A missed regression here isn't an inconvenience; it's a blank report after signing, a missing accession, or a formatting error in a clinical impression. That's not a context where "good enough" ships.

HERE'S WHAT YOU'LL BE DOING
  • Own test automation strategy for your domain. Decide what to test, at which level, and why, across complex features and the teams that build them. Balance short-term delivery with the long-term health of our test suites.
  • Design automation others build on. Build scalable, maintainable frameworks, fixtures, and utilities that engineers use to write their own tests. Partner with engineers to improve testability, and use AI-assisted test generation where it raises quality and speed.
  • Make release risk explicit. Run pre-release risk assessments, build the test matrix across integrations, environments, and customer workflows, and lead test planning for high-risk releases and hotfixes. Help define the go/no-go signals your domain ships on.
  • Test the way radiologists work. Turn radiologist personas and real workflows into test cases. Bring customer-matched environments into validation, such as Windows and Electron workstations, dictation systems, and PACS/RIS integrations, and use exploratory testing where automation falls short.
  • Keep the test signal trustworthy. Drive down flaky and low-signal tests, triage failures quickly, cut suite execution time, and improve test data and environment stability with our platform teams.
  • Lead non-functional quality in your domain. Lead or co-lead performance and load testing, security checks in pipelines, and accessibility and compliance coverage such as HIPAA-related auditability.
  • Test AI systems responsibly. Design evaluations for non-deterministic outputs, such as speech recognition and generated impressions, that don't hinge on a single result.
  • Turn escaped defects into prevention. Use incident reviews and customer-reported defects to add regression coverage and update risk profiles, so the same failure doesn't reach a radiologist twice.
  • Use data to guide decisions. Track escaped defects, test stability, and time to detect for your domain, and keep suites organized in our test case management system so results are visible and comparable.
  • Raise the bar around you. Mentor TAEs and software engineers across teams, act as a trusted quality partner to Engineering Managers on risk and release readiness, and contribute to hiring, onboarding, and our Quality community.
WHO WE'RE LOOKING FOR
  • This role requires working from our San Francisco office.
  • 6+ years of software engineering or test automation experience, including 3+ years designing and owning automation frameworks.
  • Strong programming skills in TypeScript and/or Python; experience with an object-oriented language such as C# or Java is a plus.
  • Deep experience with end-to-end frameworks such as Playwright, Selenium, or Cypress.
  • API testing experience across REST and GraphQL services (for example ASP.NET http://ASP.NET Core Minimal API, FastAPI, Postman), including how tests interact with data and downstream dependencies.
  • Experience building tests into CI/CD pipelines such as GitHub Actions or CircleCI, including
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Test Automation Engineer
Senior Test Automation Engineer

Rad AI • United States

On-site
USD 110,000 - 180,000
Medical Insurance
HSA/FSA
401(k)
+4
Senior Test Automation Engineer
Senior Test Automation Engineer

Rad AI • San Francisco (CA)

On-site
USD 140,000 - 180,000
Comprehensive Benefits (Medical,Dental
401(k) plan
Paid time off
+1
Senior Test Automation Engineer (Fully Remote)
Senior Test Automation Engineer (Fully Remote)

Rad AI • United States

Remote
USD 100,000 - 150,000
Senior Test Automation Architect – AI-Driven Healthcare
Senior Test Automation Architect – AI-Driven Healthcare

Rad AI • San Francisco (CA)

On-site
USD 140,000 - 180,000
Comprehensive Benefits (Medical,Dental
401(k) plan
Paid time off
+1
Senior Test Automation Engineer – AI-Driven Healthcare
Senior Test Automation Engineer – AI-Driven Healthcare

Rad AI • United States

On-site
USD 110,000 - 180,000
Medical Insurance
HSA/FSA
401(k)
+4
Senior Test Automation Engineer
Senior Test Automation Engineer

present of AI • United States

Remote
USD 120,000 - 180,000
Senior AI Test Automation Engineer
Senior AI Test Automation Engineer

present of AI • United States

Remote
USD 120,000 - 180,000
Lead AI Test Automation Engineer — Healthcare
Lead AI Test Automation Engineer — Healthcare

Radai • San Francisco (CA)

On-site
USD 140,000 - 190,000
Head of Quality Engineering
Head of Quality Engineering

Rad AI • San Francisco (CA)

On-site
USD 180,000 - 250,000
Medical, Dental, Vision & Life
401(k)
PTO / Flexible PTO
+2
Automation Test Engineer
Automation Test Engineer

Apt • Birmingham (AL)

On-site
USD 90,000 - 130,000