Remote AI QA Analyst for Legal AI Solutions

McDermott Will & Schulte; San Diego (CA); Remote; USD 93,000 - 142,000; Full time

Job summary

McDermott Will & Schulte is building an AI-driven QA program and seeks a QA Analyst to own the full testing lifecycle for AI-powered solutions. You will partner with analysts and engineering to implement AI-assisted test generation and evaluation, and integrate automated tests into the Azure DevOps CI/CD pipeline.

The role emphasizes a remote-first, technically rigorous team that values production quality and strong testing practices across functional and non-functional areas.

Qualifications

• 4+ years of formal QA experience with test script creation and execution.
• Experience in unit, integration, system, and regression testing, both manual and automated.
• Experience integrating test suites into CI/CD pipelines using Azure DevOps.

Responsibilities

• Own the full QA lifecycle for AI-powered solutions from unit and integration testing through system, performance, and scalability testing.
• Coordinate with Analysts to generate and evaluate test cases using AI-assisted tools, focusing on boundary conditions and AI output validation.
• Collaborate with engineering to define and integrate automated test suites into the Azure DevOps CI/CD pipeline.
• Define system-level test strategies covering functional, regression, and non-functional testing requirements.
• Coordinate with the security team to translate security testing guidance into test cases.
• Evaluate AI solution reliability across varied inputs for consistent behavior.
• Maintain test documentation, defect tracking, and quality metrics for leadership visibility.
• Champion a quality culture across the delivery team, integrating testing into development workflow.

Skills

Unit testing

Integration testing

System testing

Regression testing

Automation testing

AI fluency

Education

BS in Computer Science, Information Systems, Engineering, or equivalent

Tools

Azure DevOps

Job description

McDermott Will & Schulte is building an AI-driven QA program and seeks a QA Analyst to own the full testing lifecycle for AI-powered solutions. You will partner with analysts and engineering to implement AI-assisted test generation and evaluation, and integrate automated tests into the Azure DevOps CI/CD pipeline.

The role emphasizes a remote-first, technically rigorous team that values production quality and strong testing practices across functional and non-functional areas.