Remote AI QA Analyst - CI/CD & Edge-Case Testing

McDermott Will & Schulte; United States; Remote; USD 90,000 - 130,000; Full time

Benefits offered by this job

Remote-first

Job summary

McDermott Will & Schulte is building a cutting-edge AI program within the legal tech space, seeking an AI QA Analyst to own the full QA lifecycle from unit tests to system and performance validations. You will leverage AI-enabled tools to craft tests, validate AI outputs, and drive quality across practices and operational teams.

The role emphasizes collaboration with AI Solutions Analysts and engineering, deep CI/CD integration in Azure DevOps, and a strong focus on security testing and

Qualifications

• 4+ years of formal QA experience, including writing and executing test scripts across the full testing lifecycle.
• Strong experience with unit, integration, system, and regression testing - both manual and automated.
• Hands-on experience integrating test suites into CI/CD pipelines; Azure DevOps experience strongly preferred.
• AI fluency - you use AI tools actively and can direct leading AI platforms to generate, evaluate, and refine test cases.

Responsibilities

• Own the full QA lifecycle for AI-powered solutions - from unit and integration testing through system, performance, and scalability testing
• Partner with Analysts to generate and evaluate test cases using AI-assisted tools, with particular focus on boundary conditions, edge cases, and AI output validation
• Work with the engineering team to define and integrate automated test suites into the Azure DevOps CI/CD pipeline for each solution
• Define system-level test strategies in collaboration with the Director of QA, covering functional, regression, and non-functional testing requirements
• Coordinate with the dedicated security team to translate security testing guidance into solution-specific security test cases
• Evaluate AI solution reliability across varied inputs - ensuring consistent, predictable behavior under real-world conditions
• Maintain test documentation, defect tracking, and quality metrics that give leadership clear visibility into solution readiness
• Champion a quality culture across the delivery team - making testing a natural part of the development workflow, not a gate at the end

Skills

AI fluency

QA experience 4+ years

CI/CD testing

Azure DevOps

Edge-case testing

Load testing

Education

BS in Computer Science, Information Systems, Engineering

Tools

Azure DevOps

Job description

McDermott Will & Schulte is building a cutting-edge AI program within the legal tech space, seeking an AI QA Analyst to own the full QA lifecycle from unit tests to system and performance validations. You will leverage AI-enabled tools to craft tests, validate AI outputs, and drive quality across practices and operational teams.

The role emphasizes collaboration with AI Solutions Analysts and engineering, deep CI/CD integration in Azure DevOps, and a strong focus on security testing and