Remote AI Solutions QA Analyst

McDermott Will & Schulte; Boca Raton (FL); Remote; USD 93,000 - 142,000; Full time

Job summary

McDermott Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry, and we are seeking an AI Solutions QA Analyst to own the full QA lifecycle for AI-powered solutions.

You will collaborate with Analysts and engineers to design test cases, implement automated suites in Azure DevOps, and ensure production-ready quality across functional, non-functional, and security testing in a remote-first environment.

Qualifications

• Experience using AI tools (e.g., Claude, ChatGPT) for testing lifecycle.
• 4+ years of formal QA experience with writing and executing test scripts across the full testing lifecycle.
• Strong experience with unit, integration, system, and regression testing (manual and automated).
• Experience integrating test suites into CI/CD pipelines; Azure DevOps experience strongly preferred.
• Ability to design boundary and edge case tests for data-driven applications.
• BS in Computer Science, Information Systems, Engineering, or equivalent experience.

Responsibilities

• Own full QA lifecycle for AI-powered solutions, including unit, integration, system, and performance testing.
• Collaborate with Analysts to generate/evaluate AI-assisted test cases.
• Integrate automated test suites into Azure DevOps CI/CD.
• Define system-level test strategies for functional, regression, and non-functional testing.
• Coordinate with security team to convert security testing guidance into test cases.
• Evaluate AI solution reliability across varied inputs.
• Maintain test documentation, defect tracking, and quality metrics.
• Champion quality culture within the delivery team.

Skills

AI fluency

QA experience

Unit testing

CI/CD integration

Test automation

Analytical thinking

Education

BS in CS/IS/Engineering

Tools

Azure DevOps

Job description

McDermott Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry, and we are seeking an AI Solutions QA Analyst to own the full QA lifecycle for AI-powered solutions.

You will collaborate with Analysts and engineers to design test cases, implement automated suites in Azure DevOps, and ensure production-ready quality across functional, non-functional, and security testing in a remote-first environment.