Senior Quality Engineer AI-Driven Testing at Scale

Zipliens; Franklin (VA); On-site; USD 98,000 - 132,000; Full time

Benefits offered by this job

Private Health Care Plan

Company HSA contributions

Flexible Spending Accounts

Company-Paid Short-Term Disability

Voluntary Long-Term Disability, Life,

401(k) Plan with Company Match

Paid Time Off

Parental Leave

Job summary

Zipliens is seeking a Senior Quality Engineer to set quality standards for a growing engineering team and to build robust testing for data-heavy products at scale. You’ll lead the QA effort across features, define acceptance criteria, and shape automation and AI-driven validation strategies.

You’ll collaborate with product to drive release quality, mentor engineers, and ensure risk-based testing informs every release planning decision in our fast-growing lien-resolution platform.

Qualifications

• 5+ years on a QA or software development team with diverse products and testing approaches.
• Expert in at least one of exploratory testing or test design, automation, or AI/LLM evaluation.
• Experience setting test standards and driving framework adoption.
• Significant automation experience in modern frameworks with CI/CD gating.
• Comfortable with Python/Django backend and React frontend; review test code.
• Strong SQL and PostgreSQL; verify data and UI outcomes.
• Hands-on evaluation of AI/ML features in production and monitoring quality.
• Experience mentoring quality engineers and raising standards.
• Excellent written and verbal communication for cross-functional teams.

Responsibilities

• Lead quality for medium to large features; own risk analysis, test strategy, release criteria, and sign-off.
• Set and advocate test standards and frameworks; define sufficient coverage and passing criteria.
• Own automation and CI/CD gating strategy; manage runtimes and flakiness.
• Own evaluation methodology for LLM features; sampling, rubrics, and drift monitoring.
• Set standards for validating AI-generated output in product and tests.
• Collaborate with Product Owner to define Acceptance and Release Criteria.
• Evaluate and introduce new testing tools and AI capabilities.
• Mentor quality engineers and coach on exploratory testing and risk-based testing.
• Influence testability in early design decisions.

Skills

Exploratory testing

Test design

Test automation

AI/LLM evaluation

Risk-based testing

Mentoring

Communication

Python

Tools

Playwright

Cypress

pytest

CI/CD

Agentic tools

Job description

Zipliens is seeking a Senior Quality Engineer to set quality standards for a growing engineering team and to build robust testing for data-heavy products at scale. You’ll lead the QA effort across features, define acceptance criteria, and shape automation and AI-driven validation strategies.

You’ll collaborate with product to drive release quality, mentor engineers, and ensure risk-based testing informs every release planning decision in our fast-growing lien-resolution platform.