Quality Engineer: AI-Driven Testing for Legal Tech

Zipliens; Franklin (VA); On-site; USD 77,000 - 104,000; Full time

Benefits offered by this job

Private Health Care Plan (Medical, Eye

Dental & Vision

Company HSA contributions for HDHP

Flexible Spending Accounts (Health & 0

Company-Paid Short-Term Disability

Voluntary Long-Term Disability, Life,¿

401(k) Plan with Company Match

Paid Time Off

Parental Leave

Job summary

Zipliens is seeking a Quality Engineer to own quality for a product area and build the test strategy and automation behind it. You’ll work with engineering teams to ensure reliability at scale, including AI/LLM evaluation and non-deterministic testing, while using agentic tools to create and review tests before merging.

You will collaborate with engineers daily, define acceptance criteria with Product Owner, and own the release sign-off for your area, contributing to faster, more accurate lien

Qualifications

• 3+ years on a QA or software development team with ownership of test coverage
• Strong skills in exploratory testing or test design, automation/infrastructure, or AI/LLM evaluation
• Hands-on experience building automated test suites in modern frameworks and diagnosing flaky tests
• Comfort reading/writing code in Python/Django backend and React frontend
• Experience integrating tests into CI pipelines and deciding checks for merge/deploy
• Strong SQL skills, PostgreSQL-based testing
• Hands-on experience testing LLM/ML features and evaluating outputs
• Experience using agentic coding tools and evaluating AI-produced tests

Responsibilities

• Own quality for a feature or product area including test strategy and release sign-off
• Build and maintain automated test suites and CI integration
• Run exploratory testing of lien workflow and understand applications and risk areas
• Test LLM-based features, set acceptance thresholds, check AI output against human labels
• Develop and review AI-generated tests and automation
• Shape Acceptance Criteria with Product Owner and identify coverage gaps
• Triage and shepherd defects from reporting to resolution
• Collaborate with engineers daily in embedded QA within teams

Skills

QA Experience

Automation Testing

AI/LLM Evaluation

Python

SQL

PostgreSQL

CI/CD

Read Code (Frontend/Backend)

Tools

Playwright

Cypress

pytest

Job description

Zipliens is seeking a Quality Engineer to own quality for a product area and build the test strategy and automation behind it. You’ll work with engineering teams to ensure reliability at scale, including AI/LLM evaluation and non-deterministic testing, while using agentic tools to create and review tests before merging.

You will collaborate with engineers daily, define acceptance criteria with Product Owner, and own the release sign-off for your area, contributing to faster, more accurate lien