Automation Testing Engineer

Vaco

Birmingham (AL)

On-site

USD 110,000 - 160,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Vaco by Highspring seeks a Senior Automation Testing Engineer to own the quality engineering and test automation for an AI-powered healthcare platform. This role focuses on automation strategy, framework design, and scalable QA processes rather than manual testing.

You will build testing architectures, lead a growing QA team, and integrate automated testing into CI/CD. Experience with Python or TypeScript, and AI-assisted testing, is highly valued.

Qualifications

  • 10+ years of software quality engineering with automation focus.
  • Experience designing and owning automation frameworks from scratch.
  • Strong experience with CI/CD pipelines and test harness design.
  • Proficiency in Python or TypeScript and scripting.

Responsibilities

  • Design and implement scalable automated testing infrastructure.
  • Lead QA and automation teams as the organization grows.
  • Develop simulation and regression frameworks for AI/voice workflows.
  • Collaborate with platform, APIs, and integrations teams to ensure coverage.

Skills

Automation testing
Python
TypeScript
CI/CD
AI-assisted testing
Distributed systems

Tools

GitHub Actions
Jenkins

Job description

Senior Automation Testing Engineer

We are seeking a Senior Automation Testing Leader / Senior Automation Testing Engineer to own and build the quality engineering and test automation function for an AI-powered healthcare technology platform.

In this role, quality directly impacts patient access to healthcare. A broken call flow can prevent a patient from reaching their physician, making quality assurance an important part of the overall patient experience.

This is not a traditional manual QA position. The role is focused on test automation, framework design, automation strategy, scalable QA processes, AI-assisted testing techniques, and building a future QA organization.

What You'll Do
Automation Strategy & Leadership
  • Own the overall quality engineering vision and automation strategy for an AI-powered voice platform.
  • Design, build, and maintain scalable automated testing infrastructure from the ground up.
  • Establish testing standards, best practices, and quality metrics across engineering teams.
  • Recruit, mentor, and eventually lead future QA and automation testing team members.
  • Help drive a culture of quality throughout the organization.
Testing Architecture & Framework Development
  • Design and implement automated testing frameworks covering unit testing, integration testing, end-to-end testing, regression testing, and load/performance testing.
  • Build reusable test harnesses and tooling that enable engineers to efficiently create and execute tests.
  • Develop simulation frameworks for real-time voice and conversational AI workflows.
  • Create testing methodologies that can scale with rapid product growth.
AI & Voice Platform Testing
  • Build simulation and regression frameworks for conversational AI scenarios.
  • Develop testing approaches for real-time voice interactions and telephony workflows.
  • Leverage AI-assisted testing techniques to improve coverage and efficiency.
  • Validate agent behaviors, routing logic, integrations, and patient call flows before production deployment.
Platform & Integration Quality
  • Partner with platform, provisioning, and integrations teams to ensure comprehensive coverage across system boundaries.
  • Test APIs, backend services, event-driven systems, and third-party integrations.
  • Own test environments and CI/CD integration for automated execution.
  • Investigate production issues and lead root cause analysis efforts.
Compliance & Reliability
  • Develop testing approaches that support HIPAA and healthcare compliance requirements.
  • Help ensure platform reliability, scalability, and quality standards are consistently maintained.
  • Drive preventative quality initiatives that reduce production defects and customer-impacting issues.
Required Qualifications
  • 10+ years of experience in software quality engineering with a strong emphasis on automation.
  • Proven track record designing and owning automation frameworks from the ground up.
  • Expertise in automated testing architecture and test harness design.
  • Strong experience building scalable QA processes and automation strategies.
  • Experience leveraging AI-assisted testing methodologies.
  • Proficiency with Python, TypeScript, or similar programming languages.
  • Strong scripting, tooling, and automation development skills.
  • Experience integrating automated testing into CI/CD pipelines.
  • Hands‑on experience with GitHub Actions, Jenkins, or similar tools.
  • Deep understanding of unit testing, integration testing, end-to-end testing, regression testing, and performance testing.
  • Experience testing APIs, backend services, and distributed/event-driven architectures.
  • Strong debugging and analytical skills.
  • Demonstrated ability to elevate quality standards across engineering organizations.
  • Startup mentality with a willingness to build processes, frameworks, and teams from scratch.
  • Ability to operate as both an individual contributor and future people leader.
Preferred Qualifications
  • Experience testing real-time systems.
  • Experience with telephony platforms, call routing systems, or voice technologies.
  • Experience testing conversational AI or AI-powered applications.
  • Load and performance testing experience in high-throughput environments.
  • HIPAA-regulated healthcare experience.
  • Experience in compliance-heavy environments.
  • Contract testing experience.
  • Service virtualization experience.
  • Previous experience building or leading QA organizations.
Ideal Candidate
  • Can design testing frameworks from the ground up.
  • Can build and execute an automation-first quality strategy.
  • Understand how to leverage AI to improve testing effectiveness and efficiency.
  • Can create scalable quality processes that grow with the business.
  • Can build sophisticated test harnesses and simulation environments.
  • Thrives in a fast-paced startup-style environment.
  • Operates as a strategic quality leader rather than a traditional manual tester.
EEO Notice

Vaco by Highspring is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment because of race (including but not limited to traits historically associated with race such as hair texture and hair style), color, sex (includes pregnancy or related conditions), religion or creed, national origin, citizenship, age, disability, status as a veteran, union membership, ethnicity, gender, gender identity, gender expression, sexual orientation, marital status, political affiliation, or any other protected characteristics as required by federal, state or local law.

Vaco by Highspring and its parents, affiliates, and subsidiaries are committed to the full inclusion of all qualified individuals. As part of this commitment, Vaco by Highspring and its parents, affiliates, and subsidiaries will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact HR@vaco.com.

Vaco by Highspring also wants all applicants to know their rights that workplace discrimination is illegal.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Automation Testing Engineer
Automation Testing Engineer

Vaco Recruiter Services • Birmingham (AL)

On-site
USD 120,000 - 180,000
Medical benefits
Dental benefits
Vision benefits
+2
QA Automation Engineer
QA Automation Engineer

Veriipro • Hartford (CT)

On-site
USD 85,000 - 115,000
Technical Test Lead
Technical Test Lead

Veriipro • Hartford (CT)

On-site
USD 90,000 - 120,000
Senior QA Engineer
Senior QA Engineer

Third Way Health • Cambridge (MA)

On-site
USD 130,000 - 180,000
Senior Quality Assurance Engineer
Senior Quality Assurance Engineer

Worky • Philadelphia

On-site
USD 95,000 - 125,000
Health insurance
Retirement plan
Profit sharing
+1
Senior Automation QA Architect for AI Health Tech
Senior Automation QA Architect for AI Health Tech

Vaco • Birmingham (AL)

On-site
USD 110,000 - 160,000
Senior QA Engineer
Senior QA Engineer

Third Way Health, Inc. • Cambridge (MA)

On-site
USD 120,000 - 150,000
Test Automation Engineer
Test Automation Engineer

Endava • United States

Hybrid
USD 110,000 - 160,000
Hybrid work model
Competitive salary package
Performance-based bonuses
+2
Software Engineer, Test & Infrastructure III
Software Engineer, Test & Infrastructure III

Vailsys • Chicago (IL)

Hybrid
USD 110,000 - 170,000
Medical, dental, vision plans
Company-paid life insurance
401(k) with company match
+7
Software Engineer, Test & Infrastructure III
Software Engineer, Test & Infrastructure III

Vail Systems • Chicago (IL)

Hybrid
USD 120,000 - 180,000
Medical, dental, and vision plans
Company-paid life insurance and short/
Long‑term disability
+8