Remote AI Solutions QA Analyst

McDermott Will & Schulte; Dallas (TX); Remote; USD 93,000 - 142,000; Full time

Benefits offered by this job

Remote-first team

Competitive total rewards package

Performance-based bonuses

Direct impact on product quality

Job summary

McDermott Will & Schulte is seeking an AI QA Analyst to own the full QA lifecycle for AI-powered solutions. You will partner with AI analysts and engineers to design tests, validate AI outputs, and ensure production readiness in a remote-first environment.

You will define test strategies, write and execute automated and manual tests, and integrate tests into the Azure DevOps CI/CD pipeline. Strong analytical skills and a CS/Eng degree are required.

Qualifications

• 4+ years of formal QA experience with test script execution.
• Experience with unit, integration, system and regression testing (manual & automated).
• Hands-on experience integrating test suites into CI/CD pipelines; Azure DevOps preferred.
• BS in Computer Science, Information Systems, Engineering, or equivalent experience.

Responsibilities

• Own the full QA lifecycle for AI-powered solutions from unit to system testing.
• Create and evaluate test cases using AI-assisted tools with focus on edge cases.
• Collaborate with engineering to integrate automated test suites into the Azure DevOps CI/CD pipeline.
• Define system-level test strategies covering functional, regression, and non-functional testing.
• Coordinate with security team to translate testing guidance into security test cases.
• Evaluate AI solution reliability under varied real-world inputs.
• Maintain test documentation, defect tracking, and quality metrics for leadership visibility.
• Champion a quality culture across the delivery team.

Skills

AI testing

QA engineering

CI/CD pipelines

Azure DevOps

Boundary testing

Performance testing

Defect tracking

Analytical thinking

Test documentation

Education

BS in Computer Science / Information Systems / Engineering

Tools

Azure DevOps

Job description

McDermott Will & Schulte is seeking an AI QA Analyst to own the full QA lifecycle for AI-powered solutions. You will partner with AI analysts and engineers to design tests, validate AI outputs, and ensure production readiness in a remote-first environment.

You will define test strategies, write and execute automated and manual tests, and integrate tests into the Azure DevOps CI/CD pipeline. Strong analytical skills and a CS/Eng degree are required.