QA Engineering, Senior

Medallia; McLean (VA); Hybrid; USD 102,000 - 150,000; Full time

Benefits offered by this job

Health benefits

401(k)

Paid parental leave

Paid holidays

Diversity & inclusion

Job summary

Medallia seeks a GovCloud GenAI QA Engineer to own release quality end to end for GenAI onboarding in GovCloud, coordinating with MEC engineers, security, and customer management. You will lead testing strategies, develop automated suites, and mentor peers in AI feature testing.

Based in the greater DC area with a hybrid work model (Tysons vicinity prioritized), you will ensure robust validation, staging, and release criteria across complex SaaS environments.

Qualifications

• Must reside in the U.S. and hold U.S. Citizenship or a Green Card.
• Based in the greater Washington, DC area.
• 5+ years in software quality engineering or related role.
• Experience testing complex SaaS applications at application and API layers.
• Hands-on test automation integrated into CI/CD pipelines.
• Experience designing test plans and release sign-off for large features.
• Experience in regulated environments with risk-based testing.
• Bachelor's degree in CS/IS or related field.

Responsibilities

• Own GovCloud GenAI release quality end to end: test planning, staging validation, regression coverage, release sign-off, and documentation.
• Collaborate with engineering, security, release management, GovCloud teams to deploy changes safely using staging environments and APIs.
• Design test approaches for AI features where pass/fail is not binary; build datasets and workflows to track GenAI quality.
• Develop and maintain automated test suites integrated into CI/CD pipelines.
• Use AI-assisted tools to accelerate test design, automation, and documentation with GovCloud security in mind.
• Advocate for testability in design and mentor other quality engineers on automation and AI testing.

Skills

5+ years in software quality

Test automation

REST API testing

Troubleshooting complex issues

Communication with stakeholders

Regulated environments

Education

Bachelor's degree

Tools

Playwright

JavaScript/TypeScript

CI/CD tooling

Git

GovCloud/AWS

Job description

Overview

Medallia is the pioneer and market leader in Experience Management. Our award-winning SaaS platform, Medallia Experience Cloud, leads the market in the management of experiences, insights, and actions for candidates, customers, employees, patients, and residents alike.

We believe that every experience is a memory that can last a lifetime. Experiences shape the way people feel about a company. And they greatly influence how likely people are to advocate, contribute, and stay. At Medallia, we are committed to creating a world where organizations are loved by their customers and their employees.

We empower exceptional people to create extraordinary experiences together.

Bring your whole self.

The Role and Team

We are bringing new GenAI features in Medallia Experience Cloud (MEC) online for GovCloud, including Insights Assistant, Root Cause Assist, and Smart Topic Builder. This is a chance to help define how we validate AI-powered product behavior in one of the most demanding cloud environments in the industry, with the rigor our public-sector customers expect.

You will join a strong MEC engineering team with full-stack capabilities, including quality engineers, frontend engineers, and backend engineers. You will be the primary quality owner for GovCloud GenAI onboarding: validation in GovCloud staging, release criteria, and partnership with engineering from development through rollout. Beyond your assigned team, you will work with other MEC teams across related and adjacent product domains. You will also partner with GovCloud customer management and Site Reliability Engineering.

After the initial GenAI rollout, expect the role to expand within about six months to other MEC quality areas, including new innovation projects on our roadmap.

Responsibilities

• Own GovCloud GenAI release quality end to end: test planning, staging validation, regression coverage, release sign-off, and clear documentation
• Partner with software engineering, security, release management, GovCloud customer management, and customer-facing teams to deploy changes safely and resolve quality issues, using staging environments, logs, and APIs when direct customer instance access is not available
• Design and run test approaches for AI features where pass/fail is not binary, including output evaluation, guardrails, prompt regression, and edge cases. Build datasets and repeatable workflows to track GenAI quality over time
• Develop and maintain automated test suites integrated into CI/CD pipelines
• Use AI-assisted tools (Cursor, Claude, GitHub Copilot, or similar) to accelerate test design, automation, debugging, and documentation, with the security and privacy discipline GovCloud requires
• Advocate for testability in design and mentor other quality engineers on automation and AI feature testing

Candidates based in the Tysons vicinity will be prioritized as this role is Hybrid, 3 days per week onsite.

Qualifications

Minimum Qualifications

• Eligibility Requirement: Must reside in the U.S. and hold U.S. Citizenship or a Green Card (Lawful Permanent Resident) to meet GovCloud compliance and access requirements
• Eligibility Requirement: Must be based in the greater Washington, DC area
• 5+ years in software quality engineering, test automation, or a closely related role
• Experience testing complex SaaS or enterprise applications at the application and API layers, including REST services and authentication flows
• Hands-on experience with test automation integrated into CI/CD pipelines
• Experience designing test plans, executing validation, and providing release sign-off for medium-to-large features
• Experience validating releases in regulated environments where staging, logs, APIs, and risk-based judgment are core to the quality process
• Experience troubleshooting complex issues, writing technical documentation, and prioritizing testing based on risk and explaining trade-offs to technical and non-technical partners
• Bachelor's degree or equivalent experience in Computer Science, Information Systems, or a related field

Preferred Qualifications

• Experience in FedRAMP, AWS GovCloud, or other regulated cloud environments, including work with federal agencies or public-sector customers
• Experience with Playwright and JavaScript/TypeScript, or a comparable modern UI/API automation stack
• Experience testing AI, ML, or LLM-powered features, including evaluating outputs where pass/fail is not binary
• Experience using AI-assisted development tools to improve QE productivity

Medallia is committed to equal pay and transparency. The annual base salary range for this position is $101,500 - $150,000. Please note that the salary range information provided is a general guideline and combines all of the distinct labor markets within the US. It is uncommon for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on a variety of factors. Medallia considers factors such as (but not limited to) scope and responsibilities of the position, candidate’s work experience, candidate’s work location, education/training, key skills, internal peer equity, external market data, as well as, market and business considerations when making compensation decisions.

Medallia also offers competitive health and wellness benefits, including but not limited to medical, dental, vision, 401(k), short-term and long-term disability, life and AD&D insurance, statutory leaves, paid parental leave, and paid holidays. Benefits and eligibility may vary by location and role.

At Medallia, we celebrate diversity and recognize the value it brings to our customers and employees. Medallia is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age (40 and over), disability, genetic information, veteran status or military service, or any other status protected by state or local law. Individuals with a disability who need an accommodation to apply please contact us at [e-mail]. For information regarding how Medallia collects and uses personal information, please review our Privacy Policies. Applications will be accepted for 30 days from the date this role was posted or until the role has been filled.