Remote AI Solutions QA Analyst

McDermott Will & Schulte; Miami (FL); Remote; USD 93,000 - 142,000; Full time

Job summary

McDermott Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry — and quality is not an afterthought. As we deploy AI-powered solutions across legal practices and operations, we need a QA Analyst to own the full lifecycle: from unit tests and edge cases through system, performance, and CI/CD integration.

The AI Solutions QA Analyst works with AI tools and partners with Analysts and engineering to ensure every solution shipped is tested, reliable, and

Qualifications

• AI fluency — you use AI tools actively and can direct leading AI platforms to generate, evaluate, and refine test cases
• 4+ years of formal QA experience, including writing and executing test scripts across the full testing lifecycle
• Strong experience with unit, integration, system, and regression testing — both manual and automated
• Hands-on experience integrating test suites into CI/CD pipelines; Azure DevOps experience strongly preferred
• Demonstrated ability to design boundary and edge case tests for complex, data-driven applications
• Understanding of performance and scalability testing concepts; experience with load testing tools a plus
• Solid grasp of defect tracking, test documentation, and quality metrics reporting
• Strong analytical thinking — you approach untested AI behavior the way an engineer approaches an unknown system
• BS in Computer Science, Information Systems, Engineering, or equivalent experience

Responsibilities

• Own the full QA lifecycle for AI-powered solutions — from unit and integration testing through system, performance, and scalability testing
• Partner with Analysts to generate and evaluate test cases using AI-assisted tools, with focus on boundary conditions and AI output validation
• Work with the engineering team to define and integrate automated test suites into the Azure DevOps CI/CD pipeline for each solution
• Define system-level test strategies in collaboration with the Director of QA, covering functional, regression, and non-functional testing requirements
• Coordinate with the dedicated security team to translate security testing guidance into solution-specific security test cases
• Evaluate AI solution reliability across varied inputs — ensuring consistent, predictable behavior under real-world conditions
• Maintain test documentation, defect tracking, and quality metrics that give leadership visibility into solution readiness
• Champion a quality culture across the delivery team — integrating testing into the development workflow, not as a gate at the end

Skills

AI fluency

QA experience

Unit/integration testing

CI/CD pipelines

Azure DevOps

Boundary/edge case tests

Performance/scalability testing

Defect tracking/quality metrics

Analytical thinking

BS in CS/IS/Engineering

Education

BS in Computer Science, Information Systems, Engineering, or equivalent experience

Tools

Azure DevOps

Job description

McDermott Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry — and quality is not an afterthought. As we deploy AI-powered solutions across legal practices and operations, we need a QA Analyst to own the full lifecycle: from unit tests and edge cases through system, performance, and CI/CD integration.

The AI Solutions QA Analyst works with AI tools and partners with Analysts and engineering to ensure every solution shipped is tested, reliable, and