Remote AI QA Analyst — Legal Tech Solutions

McDermott Will & Schulte; Washington (District of Columbia); Remote; USD 93,000 - 142,000; Full time

Benefits offered by this job

Competitive compensation

Discretionary bonus

Comprehensive benefits package

Job summary

McDermott Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry — and quality is not an afterthought. As we deploy AI-powered solutions across legal practices and operational teams, we need someone who can own the full quality lifecycle: from unit tests and edge cases through system testing, performance, and CI/CD pipeline integration.

The AI Solutions QA Analyst partners with Analysts and engineering to ensure every solution is tested, reliable, and

Qualifications

• 4+ years of formal QA experience across full testing lifecycle.
• Experience with unit, integration, system, and regression testing (manual & automated).
• Experience integrating test suites into CI/CD pipelines, Azure DevOps preferred.
• Ability to design boundary/edge case tests for data-driven apps.
• AI fluency; able to direct AI platforms to generate and refine tests.
• Knowledge of performance and scalability testing; load testing a plus.
• Defect tracking, test documentation, and quality metrics reporting.
• Strong analytical thinking for untested AI behavior.

Responsibilities

• Own the full QA lifecycle for AI-powered solutions from unit to scalability testing.
• Generate and evaluate test cases with Analysts, focusing on edge cases and AI output.
• Define and integrate automated test suites into the Azure DevOps CI/CD pipeline.
• Create system-level test strategies covering functional, regression, and non-functional testing.
• Coordinate with security teams to translate security testing guidance into test cases.
• Evaluate AI solution reliability across varied inputs and real-world conditions.
• Maintain test docs, defect tracking, and quality metrics for leadership visibility.
• Champion a quality culture across the delivery team and integrate testing into development.

Skills

Unit testing

Integration testing

System testing

Regression testing

CI/CD pipelines

Azure DevOps

AI testing

Load testing

Defect tracking

Test documentation

Quality metrics

Analytical thinking

Education

BS in Computer Science, Information Systems, Engineering, or equivalent

Tools

Azure DevOps

Job description

McDermott Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry — and quality is not an afterthought. As we deploy AI-powered solutions across legal practices and operational teams, we need someone who can own the full quality lifecycle: from unit tests and edge cases through system testing, performance, and CI/CD pipeline integration.

The AI Solutions QA Analyst partners with Analysts and engineering to ensure every solution is tested, reliable, and