Testing Manager - Remote (WFH)

COGNITIVE MEDICAL SYSTEMS INC; United States; Remote; USD 100,000 - 130,000; Full time

Job summary

Cognitive Medical Systems Inc is seeking a Testing Manager to lead automated, performance, and security testing across the CMS DDPS and PRS systems. The role owns the end-to-end QA strategy, with an 80 percent automated unit test coverage mandate and BDD/TDD practices within the CMS enterprise environment.

This is a remote position available to candidates in VA, DC, MD, TN, FL, AZ, CO, OR, and TX, with responsibilities to integrate tests into CI/CD, monitor quality metrics, and coordinate

Qualifications

• Bachelor's degree in Computer Science or related field and 8+ years in software QA with test automation leadership on production systems.
• Hands-on expertise with Python test frameworks, Pytest and UnitTest.
• Experience with database testing using DBFit and FitNesse.

Responsibilities

• Own automated, performance, and security testing across the DDPS/PRS estate; sustain 80 percent+ automated unit test coverage using Python Pytest/UnitTest and DBFit/FitNesse; support BDD and TDD practices.
• Integrate automated test execution into CI/CD pipelines via Jenkins/CloudBees, JFrog Artifactory, SonarQube, and Snyk.
• Operate with TestRail, JIRA, and GitHub for test management and source-controlled artifacts.
• Define and monitor QASP performance standards, metrics, and reporting; submit quarterly self-assessments.
• Track real-time quality metrics using CloudWatch, Splunk, and New Relic; coordinate security testing with Nessus, CrowdStrike, AWS Inspector, SecurityHub, GuardDuty.

Skills

Python

Pytest

UnitTest

Test automation

QA leadership

Education

Bachelor's degree in Computer Science or related field

Tools

TestRail

JIRA

GitHub

Jenkins

CloudBees

Artifactory

XRay

Snyk

DBFit

FitNesse

SonarQube

Snyk

New Relic

Splunk

CloudWatch

Nessus

CrowdStrike

AWS Inspector

SecurityHub

GuardDuty

Job description

Full-Time US

Salary Range: $100,000.00 To $130,000.00 Annually

About Cognitive:

Cognitive is an IT and software engineering services company dedicated to elevating the quality, speed and delivery of today’s US government healthcare programs. With a wealth of clinical expertise and hands-on experience, our team understands the significant challenges our government clients—and their customers—face every day. This real-world experience equips us to develop IT solutions that seamlessly connect all facets of healthcare delivery. At Cognitive, we’re guiding government agencies to the forefront of technology innovation in healthcare delivery.

Position Overview:

*This position is contingent upon contract award*

The Testing Manager is responsible for automated testing, performance testing, and security testing across the CMS Drug Data Processing System (DDPS) and Payment Reconciliation System (PRS). This individual owns the end-to-end quality assurance strategy, including the 80 percent automated unit test coverage mandate, Behavior-Driven Development (BDD) and Test-Driven Development (TDD) practices, QASP metric definition and self-assessment, and test tooling operations within the CMS enterprise test environment.

This is a remote position; however, Cognitive hires only in the following designated U.S. states based on contract and business requirements: VA, DC, MD, TN, FL, AZ, CO, OR, and TX.

Key Responsibilities:

• Own automated, performance, and security testing across the DDPS/PRS estate; maintain 80 percent or greater automated unit test coverage using Python Pytest/UnitTest and DBFit/FitNesse frameworks; support BDD and TDD practices across all sprint teams.


• Perform regression and post-implementation validation testing following each CMS release; integrate automated test execution into the CI/CD pipeline via Jenkins/CloudBees, JFrog Artifactory, SonarQube, and Snyk.


• Operate within CMS enterprise test tooling including TestRail for test case management, JIRA for defect tracking, and GitHub for source-controlled test artifacts.


• Propose and maintain QASP performance standards, metrics, measurement methods, reporting frequencies, and corrective action thresholds for both technical/system and operational/process metrics; submit quarterly QASP self-assessments no later than 2 weeks after PI end.


• Track and surface real-time operational quality metrics like PDE processing volumes, error rates, reconciliation accuracy, and system uptime using CloudWatch, Splunk, and New Relic.


• Support security testing coordination with Nessus, CrowdStrike, AWS Inspector, SecurityHub, and GuardDuty; comply with CMS AI governance policies when testing AI/ML models including bias detection and human-in-the-loop review.


• Operate within the CMS Lean-Agile Release Train adhering to the MEPS Iteration Schedule; contribute to PI Planning and submit Release Deliverables per the MEPS Agile Handbook.

Qualifications:

• Bachelor's degree in Computer Scienceor related field; 8 or more years in software QA including test automation leadership on production systems.


• Hands-on expertise with Python test frameworks, Pytest and UnitTest.


• Experience with database testing using DBFit and FitNesse frameworks.


• Experience with test management tools including TestRail, JIRA, and GitHub.


• Experience designing and enforcing automated test coverage gates at 80 percent or greater within CI/CD pipelines.


• Experience with CI/CD-integrated testing using Jenkins/CloudBees, JFrog Artifactory/XRay, SonarQube, and Snyk.


• Experience developing and maintaining QASP performance standards and submitting quarterly self-assessments on federal contracts.


• Experience with monitoring and observability tools including AWS CloudWatch, Splunk, and New Relic for real-time quality metric tracking.


• Familiarity with federal security compliance testing requirements under FISMA, NIST, and CMS ARS.


• Ability to pass CMS and internal required background checks for public trust.

Why Join Us?

• Be part of a mission-driven organization making a difference in healthcare IT.


• Collaborate with innovative and passionate professionals that are there to support you at every turn.


• Enjoy a supportive work/life balance with the flexibility of a 100% remote company.


• Benefit from opportunities for growth and development in a dynamic environment.