Remote AI Solutions QA Analyst - Quality at Scale

McDermott Will & Schulte; Boston (MA); Remote; USD 93,000 - 142,000; Full time

Benefits offered by this job

Bonus opportunities

Total rewards package

Remote-first team

Job summary

McDermott Will & Schulte is building one of the most ambitious AI programs in the legal industry. You will own the full QA lifecycle for AI-powered solutions, partnering with Analysts and engineering to ensure tests are thorough and production-ready.

The role offers remote-first collaboration and a competitive rewards package. Successful candidates will join a technically rigorous team, reporting to the Director of QA and contributing to high-visibility projects that impact every shipped

Qualifications

• 4+ years of formal QA experience across the full testing lifecycle.
• Experience with unit, integration, system, and regression testing (manual and automated).
• Hands-on experience integrating test suites into CI/CD pipelines (Azure DevOps preferred).
• Design boundary and edge case tests for complex data-driven apps.
• AI fluency—ability to use AI tools to generate, evaluate, and refine tests.
• Understanding of performance and scalability testing concepts; load testing tools a plus.
• Defect tracking, test documentation, and quality metrics reporting.

Responsibilities

• Own the full QA lifecycle for AI-powered solutions — from unit and integration testing through system, performance, and scalability testing.
• Partner with Analysts to generate and evaluate test cases using AI-assisted tools, focusing on boundary conditions and AI output validation.
• Work with engineering to define and integrate automated test suites into the Azure DevOps CI/CD pipeline for each solution.
• Define system-level test strategies covering functional, regression, and non-functional requirements.
• Coordinate with security team to translate security testing guidance into security test cases.
• Evaluate AI solution reliability across varied inputs for consistent, real-world behavior.
• Maintain test docs, defect tracking, and quality metrics for leadership visibility.
• Champion a quality culture across the delivery team; testing as part of the workflow.

Skills

QA lifecycle

Automated testing

CI/CD pipelines

Azure DevOps

AI fluency

Performance testing

Defect tracking

Test scripting

Analytical thinking

Boundary/edge cases

Education

BS in CS/IS/Engineering or equivalent

Tools

Azure DevOps

Job description

McDermott Will & Schulte is building one of the most ambitious AI programs in the legal industry. You will own the full QA lifecycle for AI-powered solutions, partnering with Analysts and engineering to ensure tests are thorough and production-ready.

The role offers remote-first collaboration and a competitive rewards package. Successful candidates will join a technically rigorous team, reporting to the Director of QA and contributing to high-visibility projects that impact every shipped