Test Automation and Metrics Engineer

OmniVista Consulting; Washington (District of Columbia); Hybrid; USD 110,000 - 170,000; Full time

Benefits offered by this job

Remote‑first

Occasional on-site in DC

Job summary

OmniVista Consulting is seeking a mid‑level Test Automation and Metrics Engineer to automate tests and convert board data into leadership dashboards. You will design and implement automation frameworks, ensure CI/CD integration, and create repeatable reporting across projects.

The role emphasizes 508/WCAG automation, performance testing, and governance. Remote-first with occasional on-site in Washington, DC; U.S. citizenship and Public Trust Tier 2 preferred.

Qualifications

• 5 to 7 years in test automation, quality engineering, or software engineering with a testing focus.
• Experience integrating automated tests into a CI/CD pipeline.
• Experience building reporting or dashboards consolidating data from multiple teams or systems.
• Experience in a federal software delivery environment.
• Bachelor's degree in CS or related field.

Responsibilities

• Build and maintain automated tests covering high-value user journeys, critical business rules, and regression-prone interfaces.
• Establish the automation foundation before writing tests: framework, project structure, coding standards, reusable components, reporting, logging, and version control integration.
• Maintain test data strategy, including realistic staged data in non-production environments.
• Perform targeted manual and exploratory testing where automation is not warranted.
• Integrate automated unit, integration, contract, and regression tests into the delivery pipeline as quality gates with defined coverage thresholds.
• Configure test reporting and failure triage so a broken build is diagnosable without manual investigation.
• Work with business analysts to convert acceptance criteria into testable scenarios covering normal paths, edge conditions, and failures.
• Automate Section 508 and WCAG 2.1 AA accessibility checks in the pipeline and support screen reader validation.
• Execute performance and load testing against stated non-functional thresholds.
• Verify recovery, failover, and error handling behavior against design requirements.
• Build consolidated dashboards drawing from many project boards, covering portfolio health, product performance, security posture, and financial metrics.
• Standardize the small set of fields and relationships that make roll-up reporting possible without manual re-entry.
• Automate recurring report generation and distribution.
• Report coverage of new code, escaped defects, pipeline success rate, and accessibility findings caught before release.
• Maintain independence between development and test: components are tested by someone other than the person who built them.
• Maintain test plans and traceability from requirement to test case to result.
• Participate in release readiness reviews and document test procedures.

Skills

CI/CD integration

Accessibility testing knowledge

Dashboard reporting understanding

Education

Bachelor's degree in Computer Science or related field

Tools

Selenium

Playwright

Cypress

Job description

Location Washington, DC metro area — remote with occasional on-site presence; local residency required

Clearance Public Trust Tier 2 (Moderate Background Investigation)

The Test Automation and Metrics Engineer is responsible for building automated test coverage where little currently exists and for converting data from more than 50 project boards into dashboards leadership can act on. This is a two-part role: automate testing that is presently manual, and automate reporting that is presently assembled by hand. Both remove recurring work from a team without spare capacity. The position works closely with the DevSecOps engineer, business analyst, and government product managers.

Level: Mid-level — 5 to 7 years

Location: Remote, with occasional on-site presence in Washington, DC. Candidates must currently reside in the Washington, DC metropolitan area (DC, Maryland, or Northern Virginia). Relocation is not offered.

Clearance: Public Trust Tier 2 (Moderate Background Investigation). U.S. Citizen a Must. An active Tier 2 Public Trust or higher is strongly preferred.

Key Responsibilities

Test Automation Engineering

• Build and maintain automated tests covering high-value user journeys, critical business rules, and regression-prone interfaces.
• Establish the automation foundation before writing tests: framework, project structure, coding standards, reusable components, reporting, logging, and version control integration.
• Maintain test data strategy, including realistic staged data in non-production environments.
• Perform targeted manual and exploratory testing where automation is not warranted.

Pipeline Integration and Quality Gates

• Integrate automated unit, integration, contract, and regression tests into the delivery pipeline as quality gates with defined coverage thresholds.
• Configure test reporting and failure triage so a broken build is diagnosable without manual investigation.
• Work with business analysts to convert acceptance criteria into testable scenarios covering normal paths, edge conditions, and failures.

Accessibility and Non-Functional Testing

• Automate Section 508 and WCAG 2.1 AA accessibility checks in the pipeline and support screen reader validation.
• Execute performance and load testing against stated non-functional thresholds.
• Verify recovery, failover, and error handling behavior against design requirements.

Metrics, Dashboards, and Reporting

• Build consolidated dashboards drawing from many project boards, covering portfolio health, product performance, security posture, and financial metrics.
• Standardize the small set of fields and relationships that make roll-up reporting possible without manual re-entry.
• Automate recurring report generation and distribution.
• Report coverage of new code, escaped defects, pipeline success rate, and accessibility findings caught before release.

Collaboration and Test Governance

• Maintain independence between development and test: components are tested by someone other than the person who built them.
• Maintain test plans and traceability from requirement to test case to result.
• Participate in release readiness reviews and document test procedures.

Required Qualifications

Education

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent experience.

Experience

• 5 to 7 years in test automation, quality engineering, or software engineering with a testing focus, including establishing an automation framework rather than only extending an existing one.
• Demonstrated experience integrating automated tests into a CI/CD pipeline.
• Experience building reporting or dashboards consolidating data from multiple teams or systems.
• Experience in a federal software delivery environment.

Technical Skills

• Hands‑on automation with Selenium, Playwright, Cypress, or comparable.
• API test automation with Postman, REST Assured, or comparable.
• Test management in Azure DevOps Test Plans, Zephyr, or comparable.
• Performance testing with JMeter, LoadRunner, or k6.
• Accessibility test automation with axe, WAVE, or a screen reader such as JAWS or NVDA.
• Dashboard and reporting proficiency in Power BI or Tableau, including data preparation and modeling.
• Familiarity with static analysis tools such as SonarQube.

Certifications (Preferred)

• ISTQB Certified Tester, Foundation or Advanced Level
• Certified Professional in Accessibility Core Competencies (CPACC)
• CompTIA Security+
• Preference for automating a recurring task over performing it well repeatedly.
• Ability to build a test suite that is maintained rather than abandoned.
• Comfort presenting quality and delivery data to management.
• Strong documentation skills for test design and procedures.

Work Arrangement and Travel

This position is remote-first. Expect to be on site in Washington, DC a few days per month for customer meetings, quarterly planning, and team offsites, scheduled in advance. Standard business hours, Eastern time, Monday through Friday, with occasional scheduled maintenance windows planned in advance.

About OmniVista Consulting. OmniVista is an 8(a)-certified, minority-owned Economically Disadvantaged Woman-Owned Small Business delivering enterprise IT services to federal customers since 2013. This role supports a federal agency; the agency is identified during the interview process. OmniVista is an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.