Remote Testing Manager: Automated QA & Security

Visa Hunt

United States

Remote

USD 110,000 - 170,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Cognitive is an IT and software engineering services company delivering value to US government healthcare programs through quality software delivery. The Testing Manager leads automated, performance, and security testing for CMS DDPS/PRS, ensuring 80%+ automated unit test coverage and alignment with BDD/TDD practices in a federal contract environment.

The role emphasizes CI/CD integration, TestRail/JIRA/GitHub tooling, and real-time quality metrics via CloudWatch, Splunk, and New Relic while

Qualifications

Bachelor's degree in Computer Science or related field; 8+ years in software QA including test automation leadership on production systems.
Hands-on expertise with Python test frameworks, Pytest and UnitTest.
Experience with database testing using DBFit and FitNesse frameworks.
Experience with test management tools including TestRail, JIRA, and GitHub.
Experience designing and enforcing automated test coverage gates at 80 percent or greater within CI/CD pipelines.
Experience with CI/CD-integrated testing using Jenkins/CloudBees, JFrog Artifactory/XRay, SonarQube, and Snyk.
Experience designing performance test approaches for high-volume data processing systems.
Experience developing and maintaining QASP performance standards and submitting quarterly self-assessments on federal contracts.
Experience with monitoring and observability tools including AWS CloudWatch, Splunk, and New Relic for real-time quality metric tracking.
Familiarity with federal security compliance testing requirements under FISMA, NIST, and CMS ARS.
Ability to pass CMS and internal required background checks for public trust.

Responsibilities

Own automated, performance, and security testing across the DDPS/PRS estate; maintain 80 percent or greater automated unit test coverage using Python Pytest/UnitTest and DBFit/FitNesse frameworks; support BDD and TDD practices across all sprint teams.
Perform regression and post-implementation validation testing following each CMS release; integrate automated test execution into the CI/CD pipeline via Jenkins/CloudBees, JFrog Artifactory, SonarQube, and Snyk.
Operate within CMS enterprise test tooling including TestRail for test case management, JIRA for defect tracking, and GitHub for source-controlled test artifacts.
Propose and maintain QASP performance standards, metrics, measurement methods, reporting frequencies, and corrective action thresholds for both technical/system and operational/process metrics; submit quarterly QASP self-assessments no later than 2 weeks after PI end.
Track and surface real-time operational quality metrics like PDE processing volumes, error rates, reconciliation accuracy, and system uptime using CloudWatch, Splunk, and New Relic.
Support security testing coordination with Nessus, CrowdStrike, AWS Inspector, SecurityHub, and GuardDuty; comply with CMS AI governance policies when testing AI/ML models including bias detection and human-in-the-loop review.
Operate within the CMS Lean-Agile Release Train adhering to the MEPS Iteration Schedule; contribute to PI Planning and submit Release Deliverables per the MEPS Agile Handbook.