Remote AI Solutions QA Analyst

McDermott Will & Schulte; Austin (CO); Remote; USD 93,000 - 142,000; Full time

Benefits offered by this job

Remote-first

Competitive total rewards

Performance-based bonuses

Job summary

McDermott Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry, and quality is foundational. As the AI Solutions QA Analyst, you will own the full QA lifecycle—from unit tests to system and performance testing, and you will collaborate with AI analysts and engineering to ensure production-ready solutions.

You will leverage AI tools to generate and evaluate test cases, integrate automated suites into the Azure DevOps CI/CD pipeline, and help translate

Qualifications

• 4+ years of formal QA experience, including writing and executing test scripts across the full testing lifecycle.
• Hands-on experience integrating test suites into CI/CD pipelines; Azure DevOps strongly preferred.
• AI fluency; you actively use AI tools to generate, evaluate, and refine test cases.
• BS in Computer Science, Information Systems, Engineering, or equivalent experience.
• Experience with unit, integration, system, and regression testing, both manual and automated.

Responsibilities

• Own the full QA lifecycle for AI-powered solutions—from unit and integration testing through system, performance, and scalability testing.
• Partner with Analysts to generate and evaluate test cases using AI-assisted tools, focusing on boundary conditions and edge cases.
• Work with engineers to define and integrate automated test suites into the Azure DevOps CI/CD pipeline.
• Define system-level test strategies in collaboration with the Director of QA, covering functional, regression, and non-functional testing requirements.
• Coordinate with security teams to translate testing guidance into security test cases.
• Evaluate AI solution reliability across varied inputs to ensure consistent, real-world performance.
• Maintain test documentation, defect tracking, and quality metrics for clear leadership visibility.

Skills

AI fluency

QA experience

Test automation

Azure DevOps

Edge cases

Performance testing

Defect tracking

Analytical thinking

BS degree

Education

BS in CS/IS/Engineering

Tools

Azure DevOps

Job description

McDermott Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry, and quality is foundational. As the AI Solutions QA Analyst, you will own the full QA lifecycle—from unit tests to system and performance testing, and you will collaborate with AI analysts and engineering to ensure production-ready solutions.

You will leverage AI tools to generate and evaluate test cases, integrate automated suites into the Azure DevOps CI/CD pipeline, and help translate