AI Systems Quality Specialist

Eversana; Overland Park (KS); On-site; USD 90,000 - 131,000; Full time

Job summary

EVERSANA INTOUCH is seeking an AI Systems Quality Specialist to design, build, and oversee the QA framework for the AI Agency Platform. This role ensures features, integrations, and AI-driven processes operate reliably and compliantly across Google Cloud, Veeva, SFMC, and Aprimo.

The ideal candidate will lead automated testing within CI/CD pipelines, collaborate with DevOps, Product, and AI teams, and drive quality benchmarks while maintaining audit-ready documentation and dashboards.

Qualifications

• 7+ years of experience in QA automation or software testing, with 3+ years in a lead or senior role.
• Experience with test automation frameworks such as PyTest, Selenium.
• Strong understanding of API testing (Postman) and data validation (SQL, Snowflake, BigQuery).
• Proven experience testing integrated SaaS systems in cloud environments (preferably Google Cloud).
• Familiarity with CI/CD and continuous testing practices.
• Excellent documentation, reporting, and stakeholder communication skills.

Responsibilities

• Design, implement, and maintain a comprehensive automation framework for functional, regression, and integration testing.
• Build automated test scripts for APIs, UI workflows, data pipelines, and AI agent interactions using tools such as PyTest or Selenium.
• Integrate automated tests into CI/CD pipelines (Jenkins, GitHub Actions, or Cloud Build) to support continuous delivery.
• Ensure test scripts cover both core platform functionality and partner integrations (Veeva Vault, Vertex AI, Snowflake).
• Standardize QA practices for cross-team use and document testing methodologies.

Skills

QA automation

Leadership

CI/CD

API testing

PyTest

Selenium

SQL

Cloud

Tools

Jira

GitHub Actions

Cloud Build

Postman

Snowflake

BigQuery

Job description

• Compensation: USD 90,000 - USD 131,000 - yearly

Company Description

EVERSANA INTOUCHis a global, full-service marketing agency network serving the life sciences industry, and is the first – and only – agency network to be part of a fully integrated commercialization platform through EVERSANA. We provide next-generation creative and media services, enterprise solutions and data analytics services for clients.

We get fired up when people talk about getting—and staying—healthy. That’s where we find our inspiration: in the very human experiences of patients, doctors, and even each other. Then, we collaborate on ways to make caring for one’s health more achievable, connecting patients and physicians with the information and tools they need.

We embrace diversity in backgrounds and experiences. Improving patient lives around the world is a priority, and we need people from all backgrounds and swaths of life to help build the future of the healthcare and the life sciences industry. We believe our people make all the difference in cultivating an inclusive culture that embraces our cultural beliefs.

Job Description

The AI Systems Quality Specialist will design, build, and oversee the quality assurance framework for EVERSANA’s AI Agency Platform.

This role ensures that every feature, integration, and AI-driven process operates reliably and compliantly. The QA Automation Lead will establish automated testing frameworks covering functional, regression, and compliance scenarios, manage integration test suites across connected systems (Google Cloud, Veeva, SFMC, Aprimo), and collaborate closely with DevOps, Product, and AI teams to uphold quality benchmarks.

The ideal candidate combines deep QA automation experience with an understanding of regulated environments and AI-enabled software systems.

ESSENTIAL DUTIES AND RESPONSIBILITIES:
Our employees are tasked with delivering excellent business results through the efforts of their teams. These results are achieved by:

Automation Framework Design & Execution

• Design, implement, and maintain a comprehensive automation framework for functional, regression, and integration testing.
• Build automated test scripts for APIs, UI workflows, data pipelines, and AI agent interactions using tools such as PyTest or Selenium.
• Integrate automated tests into CI/CD pipelines (Jenkins, GitHub Actions, or Cloud Build) to support continuous delivery.
• Ensure test scripts cover both core platform functionality and partner integrations (Veeva Vault, Vertex AI, Snowflake).
• Standardize QA practices for cross-team use and document testing methodologies.

Functional, Regression, and Compliance Testing

• Develop and execute test cases for new features, enhancements, and bug fixes.
• Conduct regression testing prior to each release to ensure platform stability.
• Define and perform compliance and validation testing to ensure platform adherence to HIPAA, GDPR, SOC 2, and MLR workflow standards.
• Work with the AI Validation and Compliance teams to evaluate AI output quality (accuracy, hallucination, tone, compliance alignment).
• Ensure traceability between business requirements, test cases, and validation results through detailed test documentation.

Integration & System Reliability Testing

• Oversee integration testing for all platform connectors and data flows (Veeva Vault, Aprimo, SharePoint, SFMC, Google Vertex AI).
• Develop synthetic test environments and mock APIs to validate complex, multi-system workflows.
• Partner with Data Engineering to validate ETL pipelines and analytics dashboards for data accuracy.
• Track and report system reliability metrics (latency, failure rate, API response times).
• Identify, log, and prioritize defects using Jira, tracking issue resolution through sprints.
• Collaborate with Product and Engineering teams to verify bug fixes and perform root cause analysis for recurring issues.
• Lead post-release validation and QA retrospectives to improve process efficiency.
• Proactively identify automation opportunities to reduce manual testing effort and cycle time.

Documentation & Audit Readiness

• Maintain test documentation, validation reports, and evidence logs for internal and external audits.
• Support compliance reviews by ensuring full traceability from requirement → test case → result → release.
• Create and maintain QA dashboards and reporting templates for leadership visibility.
• Demonstrate a commitment to diversity, equity, and inclusion through continuous development, modeling inclusive behaviors, and proactively managing bias.
• All other duties as assigned

Qualifications

MINIMUM KNOWLEDGE, SKILLS AND ABILITIES:

The requirements listed below are representative of the experience, education, knowledge, skill and/or abilities required.

• 7+ years of experience in QA automation or software testing, with 3+ years in a lead or senior role.
• Experience with test automation frameworks such as PyTest, Selenium.
• Strong understanding of API testing (Postman) and data validation (SQL, Snowflake, BigQuery).
• Proven experience testing integrated SaaS systems in cloud environments (preferably Google Cloud).
• Familiarity with CI/CD and continuous testing practices.
• Excellent documentation, reporting, and stakeholder communication skills.

Additional Information

OUR CULTURAL BELIEFS:

Patient Minded I act with the patient’s best interest in mind.

Client Delight I own every client experience and its impact on results.

Take Action I am empowered and empower others to act now.

Grow Talent I own my development and invest in the development of others.

Win Together I passionately connect with anyone, anywhere, anytime to achieve results.

Communication Matters I speak up to create transparent, thoughtful and timely dialogue.

Embrace Diversity I create an environment of awareness and respect.

Always InnovateI am bold and creative in everything I do.

EVERSANA is committed to providing competitive salaries and benefits for all employees. If this job posting includes a base salary range, itrepresentsthe low and high end of the salary range for this position and is not applicable to locations outside of theU.S.Compensation will bedeterminedbased on relevant experience, other job-related qualifications/skills, and geographic location (to account for comparative cost of living). This role is eligible for hire in select U.S. locations based on business and operational considerations. For a full list of locations, visit eversana.com/careers .More information about EVERSANA’s benefits package can be found at eversana.com/careers . EVERSANA reserves the right tomodifythis base salary rangeand benefitsat any time.

From EVERSANA’s inception, Diversity, Equity & Inclusion have always been key to our success. We are an Equal Opportunity Employer, and our employees are people with different strengths, experiences, and backgrounds who share a passion for improving the lives of patients and leading innovation within the healthcare industry. Diversity not only includes race and gender identity, but also age, disability status, veteran status, sexual orientation, religion, and many other parts of one’s identity. All of our employees’ points of view are key to our success, and inclusion is everyone's responsibility.

Consistent with the Americans with Disabilities Act (ADA) and applicable state and local laws, it is the policy of EVERSANA to provide reasonable accommodation when requested by a qualified applicant or candidate with a disability, unless such accommodation would cause an undue hardship for EVERSANA. The policy regarding requests for reasonable accommodations applies to all aspects of the hiring process. If reasonable accommodation is needed to participate in the interview and hiring process, please contact us at [e-mail] .

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply