Senior AI Solutions QA Analyst - Remote-First

McDermott Will & Schulte; Austin (CO); Remote; USD 93,000 - 142,000; Full time

Job summary

McDermott, Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry — and quality is not an afterthought.

The AI Solutions QA Analyst will own the full quality lifecycle, from unit tests and edge cases through system testing, performance, and CI/CD pipeline integration, partnering with analysts and engineers to ensure every solution is tested, reliable, and production-ready.

Qualifications

• 4+ years of QA experience across full testing lifecycle.
• Experience with unit, integration, system, and regression testing (manual and automated).
• Experience integrating test suites into CI/CD pipelines; Azure DevOps preferred.
• AI fluency to use AI tools for generating, evaluating, and refining tests.
• Knowledge of performance and scalability testing; load testing a plus.
• Defect tracking, test documentation, and quality metrics reporting.
• BS in Computer Science, Information Systems, Engineering, or equivalent.

Responsibilities

• Own the full QA lifecycle for AI-powered solutions from unit tests to scalability testing.
• Partner with Analysts to generate and evaluate test cases using AI-assisted tools.
• Work with engineering to integrate automated tests into the Azure DevOps CI/CD pipeline.
• Define system-level test strategies with the Director of QA.
• Coordinate with security to translate testing guidance into security test cases.
• Evaluate AI solution reliability across varied inputs and real-world conditions.
• Maintain test documentation, defect tracking, and quality metrics.
• Champion a quality culture across the delivery team.

Skills

QA testing lifecycle

Unit testing

Integration testing

System testing

Regression testing

CI/CD pipelines

Azure DevOps

AI tooling

Load testing

Defect tracking

Test documentation

Analytical thinking

Education

BS in Computer Science, Information Systems, Engineering, or equivalent

Tools

Azure DevOps

Job description

McDermott, Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry — and quality is not an afterthought.

The AI Solutions QA Analyst will own the full quality lifecycle, from unit tests and edge cases through system testing, performance, and CI/CD pipeline integration, partnering with analysts and engineers to ensure every solution is tested, reliable, and production-ready.