Senior QA Engineer - GovCloud (Automation & AI)

Medallia, Inc.; McLean (VA); Hybrid; USD 102,000 - 150,000; Full time

Benefits offered by this job

Health and wellness benefits

401(k) retirement plan

Paid parental leave

Paid holidays

Job summary

Medallia, Inc. is seeking a Senior QA Engineer to own GovCloud DXA release quality, build scalable Playwright automation in TypeScript/JavaScript, and lead end-to-end automated testing across UI and API.

You will collaborate with a full-stack DXA team and GovCloud customer management, focusing on reliability and AI-assisted testing practices. You will prioritize automation, design robust frameworks, and ensure security and privacy discipline in GovCloud testing, with expected hybrid onsite work

Qualifications

• 5+ years in backend, integration, and data QA or SDET roles.
• Experience converting manual checks into automated tests.
• Python tools to parse JSON and analyze logs.
• API testing of RESTful services and multi-step data delivery.
• Automated tests with Java and JUnit; CI/CD in Jenkins.
• AWS services usage and cloud log debugging.
• Release engineering with pass/fail criteria.

Responsibilities

• Own GovCloud release quality end to end: planning, staging, regression, sign-off.
• Design and maintain Playwright automation in TS/JS.
• Develop UI, API, end-to-end tests; reduce flakiness with stable locators.
• Automate manual test cases and convert to scripts.
• Implement Page Object Model, fixtures, reusable utilities, data-driven tests.
• Integrate suites into CI/CD pipelines with parallel execution and reporting.
• Leverage AI-assisted tools for test design and scripting, with secure data handling.
• Design AI feature testing for non-binary pass/fail scenarios and guardrails.
• Build datasets and workflows to track GenAI quality over time.

Skills

Backend QA

SDET

API testing

CI/CD

Python tooling

AWS (S3)

Playwright

Java

JUnit

Docker

Automation frameworks

CI/CD pipelines

Tools

Playwright

Java

JavaScript/TypeScript

JUnit

Jenkins

GitHub Actions

AWS S3

Docker

WebdriverIO

Appium

Allure

Job description

Overview

Medallia is the pioneer and market leader in Experience Management. Our award-winning SaaS platform, Medallia Experience Cloud, leads the market in the management of experiences, insights, and actions for candidates, customers, employees, patients, and residents alike.

We believe that every experience is a memory that can last a lifetime. Experiences shape the way people feel about a company. And they greatly influence how likely people are to advocate, contribute, and stay. At Medallia, we are committed to creating a world where organizations are loved by their customers and their employees.

We empower exceptional people to create extraordinary experiences together.

Bring your whole self.

The Role and Team

As a Senior QA Engineer, you will be the primary quality owner for bringing new features to Digital Experience Analytics (DXA) in GovCloud. This product analyzes user interactions across our customers' websites and applications, helping them pinpoint friction points and identify necessary improvements. This is no small endeavor, as we collect and process more than 5 petabytes of data each month.

The work spans validation in GovCloud staging, establishing release criteria, and partnering with engineering from development through rollout. You will join a full-stack DXA engineering team (comprising quality, frontend, and backend engineers), collaborate with cross-functional DXA teams in adjacent domains, and partner closely with GovCloud customer management and SRE. Following the initial rollout, the role is expected to expand within six months to cover additional DXA quality initiatives and new innovation projects.

This is a hands-on technical role combining release ownership with automation engineering: framework design, CI/CD integration, execution reliability, and the responsible adoption of AI-assisted tools.

Responsibilities

• Own GovCloud release quality end to end: test planning, staging validation, regression, sign-off, documentation
• Design, build, and maintain scalable Playwright automation frameworks using TypeScript/JavaScript
• Develop and maintain UI, API, and end-to-end automated test suites, keeping flakiness low through stable locator and wait strategies
• Identify and prioritize manual test cases suitable for automation, and convert them into automated scripts
• Implement robust patterns such as Page Object Model, fixtures, reusable utilities, and data-driven testing
• Integrate automated suites into CI/CD pipelines (e.g., Jenkins, GitHub Actions) with parallel execution, reporting, and failure triage
• Use AI-assisted tools (Cursor, Claude, Claude Code, GitHub Copilot, or similar) to accelerate test design, script creation, refactoring, debugging, failure analysis, and documentation
• Review and validate all AI-generated output before use; apply the security and privacy discipline GovCloud requires, and never share sensitive data, credentials, or customer information with AI tools
• Design and run test approaches for AI features where pass/fail is not binary, including output evaluation, guardrails, prompt regression, and edge cases
• Build datasets and repeatable workflows to track GenAI quality over time

Candidates based in the Tysons vicinity will be prioritized as this role is Hybrid, 3 days per week onsite.

Qualifications

Minimum Qualifications

• 5+ years of professional experience in backend, integration, and data QA or SDET roles.
• Hands-on experience writing queries to inspect missing or incorrect session data and converting manual verification checks into repeatable automated tests.
• Experience developing tools in Python to parse JSON, analyze system logs, compare data outputs, and report system failures.
• API Testing: Experience testing RESTful web services, including verifying multi-step systems with delayed or asynchronous data delivery.
• Experience writing automated integration tests using Java and JUnit, and managing scheduled test executions within CI/CD systems like Jenkins.
• Experience using AWS services (e.g., S3 for test artifacts) and reading cloud system logs to debug test failures.
• Release Engineering: Experience defining release criteria and establishing pass/fail deployment gates.

Preferred Qualifications

• Experience in FedRAMP, AWS GovCloud, or other regulated cloud environments, including work with federal agencies or public-sector customers
• Experience with Playwright and JavaScript/TypeScript, or a comparable modern UI/API automation stack
• Experience testing AI, ML, or LLM-powered features, including evaluating outputs where pass/fail is not binary
• Experience using AI-assisted development tools to improve QE productivity
• Experience with AI-driven testing capabilities such as self-healing locators, AI-based test generation, or MCP-based Playwright integrations
• Experience with Appium and/or WebdriverIO
• Exposure to performance, accessibility, visual regression, or security testing tools
• Experience with Docker, cloud test execution platforms, or reporting tools (Allure, etc.)
• Familiarity with contract testing, test data management, and BDD approaches

Medallia is committed to equal pay and transparency. The annual base salary range for this position is $101,500 - $150,000.USD. Please note that the salary range information provided is a general guideline and combines all of the distinct labor markets within the US. It is uncommon for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on a variety of factors. Medallia considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, candidate's work location, education/training, key skills, internal peer equity, external market data, as well as, market and business considerations when making compensation decisions.

Medallia also offers competitive health and wellness benefits, including but not limited to medical, dental, vision, 401(k), short-term and long-term disability, life and AD&D insurance, statutory leaves, paid parental leave, and paid holidays. Benefits and eligibility may vary by location and role.

At Medallia, we celebrate diversity and recognize the value it brings to our customers and employees. Medallia is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age (40 and over), disability, genetic information, veteran status or military service, or any other status protected by state or local law. For information regarding how Medallia collects and uses personal information, please review our Privacy Policies. Applications will be accepted for 30 days from the date this role was posted or until the role has been filled.