Remote AI Solutions QA Analyst

McDermott Will & Schulte; Los Angeles (CA); Remote; USD 93,000 - 142,000; Full time

Benefits offered by this job

Bonuses

Total rewards package

Job summary

McDermott Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry. The AI Solutions QA Analyst must own the full QA lifecycle for AI-powered solutions, from unit tests and edge cases through system testing, performance, and CI/CD pipeline integration.

The AI QA role partners with AI Solutions Analysts and engineering to ensure every solution is tested, reliable, and production-ready—leveraging AI to do it faster and more thoroughly than traditional QA.

Qualifications

• AI fluency and ability to direct leading AI platforms to generate/refine test cases
• 4+ years of formal QA experience with full testing lifecycle
• Strong experience in unit, integration, system, and regression testing, manual & automated
• Hands-on experience integrating test suites into CI/CD pipelines; Azure DevOps experience preferred
• Ability to design boundary/edge case tests for complex data-driven apps
• Knowledge of performance and scalability testing concepts; load testing tools a plus
• Defect tracking, test documentation, and quality metrics reporting
• Strong analytical thinking when approaching untested AI behavior
• BS in Computer Science, Information Systems, Engineering, or equivalent experience

Responsibilities

• Own the full QA lifecycle for AI-powered solutions—from unit/integration to system, performance, and scalability testing
• Collaborate with Analysts to generate/evaluate test cases using AI-assisted tools, focusing on boundaries and edge cases
• Work with engineering to define and integrate automated test suites into the Azure DevOps CI/CD pipeline
• Define system-level test strategies with the Director of QA covering functional/regression/non-functional tests
• Coordinate with security teams to translate security testing into solution-specific tests
• Evaluate AI solution reliability across varied inputs to ensure consistent behavior in real-world use
• Maintain test documentation, defect tracking, and quality metrics for leadership visibility
• Promote a quality culture where testing is integrated into development workflows

Job description

McDermott Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry. The AI Solutions QA Analyst must own the full QA lifecycle for AI-powered solutions, from unit tests and edge cases through system testing, performance, and CI/CD pipeline integration.

The AI QA role partners with AI Solutions Analysts and engineering to ensure every solution is tested, reliable, and production-ready—leveraging AI to do it faster and more thoroughly than traditional QA.