Software Quality Engineer

ZipLiens; Franklin (VA); On-site; USD 77,000 - 104,000; Full time

Benefits offered by this job

Private Health Care Plan (Medical, Eye

Dental & Vision

Company HSA contributions for HDHP

Flexible Spending Accounts (Health & 0

Company-Paid Short-Term Disability

Voluntary Long-Term Disability, Life,¿

401(k) Plan with Company Match

Paid Time Off

Parental Leave

Job summary

Zipliens is seeking a Quality Engineer to own quality for a product area and build the test strategy and automation behind it. You’ll work with engineering teams to ensure reliability at scale, including AI/LLM evaluation and non-deterministic testing, while using agentic tools to create and review tests before merging.

You will collaborate with engineers daily, define acceptance criteria with Product Owner, and own the release sign-off for your area, contributing to faster, more accurate lien

Qualifications

• 3+ years on a QA or software development team with ownership of test coverage
• Strong skills in exploratory testing or test design, automation/infrastructure, or AI/LLM evaluation
• Hands-on experience building automated test suites in modern frameworks and diagnosing flaky tests
• Comfort reading/writing code in Python/Django backend and React frontend
• Experience integrating tests into CI pipelines and deciding checks for merge/deploy
• Strong SQL skills, PostgreSQL-based testing
• Hands-on experience testing LLM/ML features and evaluating outputs
• Experience using agentic coding tools and evaluating AI-produced tests

Responsibilities

• Own quality for a feature or product area including test strategy and release sign-off
• Build and maintain automated test suites and CI integration
• Run exploratory testing of lien workflow and understand applications and risk areas
• Test LLM-based features, set acceptance thresholds, check AI output against human labels
• Develop and review AI-generated tests and automation
• Shape Acceptance Criteria with Product Owner and identify coverage gaps
• Triage and shepherd defects from reporting to resolution
• Collaborate with engineers daily in embedded QA within teams

Skills

QA Experience

Automation Testing

AI/LLM Evaluation

Python

SQL

PostgreSQL

CI/CD

Read Code (Frontend/Backend)

Tools

Playwright

Cypress

pytest

Job description

Zipliens is a leading lien resolution company that specializes in streamlining the lien process for personal injury law firms. Our work helps law firms operate more efficiently and helps the injured people they serve access settlement funds more quickly and accurately. We are looking for a quality engineer who is passionate about building the testing and evaluation that keeps complex, data-heavy products working correctly at scale.

Zipliens is looking for a Quality Engineer to join our team and own quality for a product area within the applications we build for the legal industry. After several years of high growth, Zipliens has become a leader in lien resolution, a process required in most personal injury settlements. The software we build supports that work, so the quality of what we ship has a clear, real-world impact on law firms and the people they represent.

We're scaling engineering significantly this year, and quality engineering is growing along with it. QA at Zipliens is embedded in the engineering teams and combines exploratory testing with automation. You'd own quality for a feature or product area, including the test strategy, the automation behind it, and the release sign-off for that area. You'll have established patterns and existing test suites to work from, and you'll help improve them as the team grows.

We also build with AI as a first-class part of the workflow, and that applies to testing as much as to development. Our product uses LLMs to extract structure from medical records and lien correspondence, so evaluating non-deterministic output is a regular part of the job. We also use agentic coding tools and internal skills and harnesses we've written ourselves to build and maintain automation, and you'd be expected to use those tools well, review what they produce, and help improve them.

Responsibilities:

• Own quality for a feature or product area, including the risk-based test strategy, the regression scope, and the release sign-off for that area.
• Build and maintain the automated test suites for your area and keep them integrated with CI. When tests fail or become flaky, you'll troubleshoot them and fix the underlying cause.
• Run exploratory testing against the lien workflow and develop a detailed understanding of the applications your team owns, including their risk areas and failure modes.
• Test our LLM-based features. This includes building the evaluation suite for a feature, setting acceptance thresholds with product (for example, precision and recall targets for extraction), checking LLM-judge agreement against human labels, and adding adversarial and prompt-injection cases.
• Use agentic coding tools to build and maintain automation, and review AI-generated tests before they merge.
• Join refinement early enough to shape Acceptance Criteria with the Product Owner, flag testability gaps before development starts, and recommend coverage and risk priorities for your area.
• Shepherd defects for your area from triage through resolution, writing clear, reproducible reports that engineers can act on.
• Work directly with the engineers on your team day to day. QA at Zipliens is embedded in the engineering teams rather than run as a separate function.

Qualifications:

• 3+ years on a QA or software development team, including experience owning test coverage for a feature or product area.
• Strong skills in at least one of exploratory testing and test design, test automation and infrastructure, or AI/LLM evaluation, with working proficiency in a second. We don't expect the same depth in all three.
• Hands-on experience building and maintaining automated test suites in a modern framework (Playwright, Cypress, pytest, or similar), including diagnosing flaky tests and fixing their root causes.
• Comfortable reading and writing code. Our backend is Python/Django and our frontend is React, and you should be able to read a change in either and understand what it affects and what it puts at risk.
• Experience integrating tests into CI pipelines and deciding which checks should gate a merge or a deploy.
• Strong SQL. Much of what we test lives in PostgreSQL, and verifying a workflow often means verifying the data it produced as well as what the UI shows.
• Hands-on experience testing LLM or ML features, whether in production or through prototypes and experimentation: building golden datasets, measuring output quality, and understanding how these systems fail.
• Experience using or experimenting with agentic coding tools, and good judgment about when their output needs a closer look.
• Clear written communication. You'll be writing defect reports, test plans, and release sign-offs for engineers and product, and explaining risk to non-technical stakeholders.

Nice to Have:

• Experience testing document processing or extraction from unstructured data.
• Experience testing third-party integrations, especially where the counterparty's documentation isn't solid and you need contract tests, sandboxes, or recorded fixtures to work around it.
• Familiarity with AWS and Kubernetes. We have an SRE who owns the cluster - you won't be running it, but you'll be reading logs and working out where a failure happened in it.
• Experience handling sensitive data such as PHI, or working under HIPAA-style requirements.

• Private Health Care Plan (Medical, Dental & Vision)
• Company HSA contributions for HDHP participants
• Flexible Spending Accounts (Health & Dependent Care)
• Company-Paid Short-Term Disability Coverage
• Voluntary Long-Term Disability, Life, AD&D, and Supplemental Coverage Options
• 401(k) Plan with Company Match
• Paid Time Off (Vacation, Sick Time & 10 paid Holidays)
• Parental Leave

Pay Disclosure: The total base salary range for this role is $77,000 - $104,000 annually with an opportunity to earn a discretionary quarterly bonus. Final compensation will be determined based on skills and experience.

Work Authorization: Applicants must be authorized to work in the United States without the need for employer-sponsored visa support now or in the future.