QA Analyst – AI-Driven Legal Drafting (Remote)

Filevine EU; San Francisco (CA); Hybrid; USD 105,000 - 150,000; Full time

Benefits offered by this job

Medical Insurance

Remote Work

Competitive Pay

Disability Insurance

Learning opportunities

Company swag

Job summary

Filevine is seeking a QA Analyst for LOIS for Word, its AI-powered legal drafting product. You will own the QA function, define the test strategy, and build automation, ensuring AI output quality and robust UI behavior across the product.

You’ll work to embed quality early in feature development and ship with confidence. The role emphasizes testing AI-driven edits, non-deterministic outputs, and collaboration with product, engineering, and legal experts to broaden test coverage.

Qualifications

• 2+ years of QA experience in product or major feature area.
• Ownership of test strategy for a product or major feature.
• Experience building QA processes and automation in fast-moving environments.
• Comfort in high ambiguity and shipping features quickly.

Responsibilities

• Define and own the test strategy, process, and QA playbook for LOIS for Word.
• Move QA upstream by coordinating with product and engineering early.
• Evaluate AI output quality across accuracy, citation reliability, and reasoning.
• Design and maintain evaluation sets to catch regressions over time.
• Test AI-generated edits for document accuracy and formatting fidelity.
• Build automated guardrails integrated into CI/CD for critical flows.
• Write structured, reproducible bug reports.
• Partner with legal domain experts to tailor test coverage for customer types.
• Advocate for a product/design mindset to improve workflows.
• Document discrepancies across product surfaces.

Skills

QA ownership

Test strategy

Automation

AI quality

Bug reporting

CI/CD

Test management

Tools

Bug tracking tools

Test management workflows

Job description

Filevine is seeking a QA Analyst for LOIS for Word, its AI-powered legal drafting product. You will own the QA function, define the test strategy, and build automation, ensuring AI output quality and robust UI behavior across the product.

You’ll work to embed quality early in feature development and ship with confidence. The role emphasizes testing AI-driven edits, non-deterministic outputs, and collaboration with product, engineering, and legal experts to broaden test coverage.