AI Solutions QA Analyst

McDermott

United States

Remote

USD 93,000 - 142,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Discretionary bonus
Competitive benefits package

Job summary

McDermott Will & Schulte LLP seeks an AI Solutions QA Analyst to own the full QA lifecycle for AI-powered solutions, partnering with AI Analysts and engineering to ensure reliable, production-ready releases. The role emphasizes AI-assisted test generation and automated CI/CD integration in a remote-first, high-visibility environment.

The candidate will apply boundary/edge-case testing, performance concepts, and robust defect tracking within a cutting-edge legal AI program.

Qualifications

  • Experience using AI tools for testing lifecycle.
  • 4+ years formal QA experience across full testing lifecycle.
  • Hands-on testing across unit, integration, system, and regression testing.
  • Experience integrating test suites into CI/CD pipelines using Azure DevOps.
  • Ability to design boundary and edge-case tests for data-driven applications.
  • Understanding of performance and scalability testing concepts; load testing knowledge is a plus.
  • Defect tracking, test documentation, and quality metrics reporting.
  • BS in Computer Science, Information Systems, Engineering, or equivalent experience.

Responsibilities

  • Own the full QA lifecycle for AI-powered solutions—unit to system, performance, and scalability testing.
  • Partner with Analysts to generate and evaluate test cases using AI-assisted tools.
  • Work with the engineering team to define and integrate automated test suites into the Azure DevOps CI/CD pipeline.
  • Define system-level test strategies in collaboration with the Director of QA.
  • Coordinate with the dedicated security team to translate security testing guidance into test cases.
  • Evaluate AI solution reliability across varied inputs and real-world conditions.
  • Maintain test documentation, defect tracking, and quality metrics for leadership visibility.
  • Champion a quality culture across the delivery team—testing as a development practice.

Skills

AI tooling
QA experience
Testing lifecycle
CI/CD automation
Boundary testing
Edge case tests
Load testing
Defect tracking
Analytical thinking

Education

BS in CS/IS/Engineering

Tools

Azure DevOps

Job description

Build your big career with the firm that does Big Law, Better. M c Dermott Will & Schulte is a leading global law firm that brings together more than 1,700+ lawyers and 1,400 business professionals. We celebrate excellence, collaboration, and community and have been recognized as a top workplace by USA Today, Fortune, The American Lawyer, Vault and others. We are also certified by Great Place to Work.

At M c Dermott, we don't just invest in your future, we accelerate your career - wherever it may lead. That includes supporting you both in and outside of the office.

With us, you'll find:

A firm where everyone belongs: Our award-winning culture prioritizes warmth and authenticity - we encourage you to be yourself!

Enthusiasm for all perspectives: We're smarter and stronger when everyone has a voice and a seat at the table. We welcome unique viewpoints and ideas, and we make opportunities for you and your career to thrive.

Support to feel your best and do your best: Wellness is integral to building a successful career and a rich life. That's why our benefits program supports your physical, emotional, mental, and financial health, with an emphasis on work-life balance.

Real rewards for real work: We offer generous compensation packages that recognize hard work and excellence.

Job Description:

M c Dermott, Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry - and quality is not an afterthought. As we deploy AI-powered solutions across legal practices and operational teams, we need someone who can own the full quality lifecycle: from unit tests and edge cases through system testing, performance, and CI/CD pipeline integration.

The AI Solutions QA Analyst must have experience using AI tools (eg. Claude, ChatGPT or other) for the testing lifecycle. AI QA Analyst partners directly with our AI Solutions Analysts and engineering team to ensure every solution we ship is tested, reliable, and production-ready - leveraging AI itself to do it faster and more thoroughly than traditional QA ever could.

WHY MWS:

Shape quality standards for an entirely new category of legal AI solutions - from the ground up

Work with frontier AI tools to build and run tests faster than traditional QA methods allow

High-visibility role reporting to Director of QA with direct impact on every solution the team ships

Remote-first, technically rigorous team that takes production quality seriously

WHAT YOU'LL DO:
  • Own thefull QA lifecyclefor AI-powered solutions - from unit and integration testing through system, performance, and scalability testing
  • Partner with Analysts togenerate and evaluate test casesusing AI-assisted tools, with particular focus on boundary conditions, edge cases, and AI output validation
  • Work with the engineering team to define and integrateautomated test suitesinto the Azure DevOps CI/CD pipeline for each solution
  • Definesystem-level test strategiesin collaboration with the Director of QA, covering functional, regression, and non-functional testing requirements
  • Coordinate with the dedicated security team to translate security testing guidance intosolution-specific security test cases
  • Evaluate AI solution reliability across varied inputs - ensuring consistent, predictable behavior under real-world conditions
  • Maintain test documentation, defect tracking, and quality metrics that give leadership clear visibility into solution readiness
  • Champion a quality culture across the delivery team - making testing a natural part of the development workflow, not a gate at the end
WHAT YOU BRING:
  • AI fluency— you use AI tools actively and can direct leading AI platforms to generate, evaluate, and refine test cases
  • 4+ yearsof formal QA experience, including writing and executing test scripts across the full testing lifecycle
  • Strong experience withunit, integration, system, and regression testing— both manual and automated
  • Hands-on experience integrating test suites intoCI/CD pipelines; Azure DevOps experience strongly preferred
  • Demonstrated ability to designboundary and edge case testsfor complex, data-driven applications
  • Understandingofperformance and scalability testingconcepts; experience with load testing tools a plus
  • Solid grasp of defect tracking, test documentation, and quality metrics reporting
  • Strong analytical thinking - you approach untested AI behavior the way an engineer approaches an unknown system
  • BS in Computer Science, Information Systems, Engineering, or equivalent experience
Preferred:
  • Experience testingAI-powered applications - prompt-driven systems, agentic workflows, or LLM-integrated tools
  • Familiarity withAI-assisted test generation workflowsand code-generating platforms
  • Exposure tosecurity testing principlesin collaboration with a dedicated security team
  • Experience in legal, financial services, or other regulated industry environments
  • KnowledgeofAzure DevOps, including pipeline configuration and automated test integration

Successful candidates will be provided with outstanding career opportunities and will receive a competitive total rewards package with the opportunity to earn performance-based bonuses.

Target Hiring Range $93,000 - $142,000

Please note that quoted salary ranges are not guarantees of what final salary offers may be. Base pay is based on market location and may vary depending on job-related knowledge, skills, experience, and geographic location. Base pay is only one part of the Total Rewards that MWE provides to compensate and recognize our staff professionals for their work. Full time positions are eligible for a discretionary bonus and a comprehensive benefits package.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Physical Demands and Work Environment:

The physical demands and work environment characteristics described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Physical Demands:

While performing the duties of this job, the employee is required to sit, use hands, reach with hands and arms, stoop, talk and hear

Employee must occasionally lift up to twenty (20) pounds

Typical indoor office environment

Disclaimer:

The above statements are intended to describe the general nature and level of the work being performed by people within this classification. They are not intended to be an exhaustive list of all responsibilities, duties and skills required of employees assigned to this job.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Solutions QA Analyst
AI Solutions QA Analyst

McDermott • Atlanta (GA)

Remote
USD 93,000 - 142,000
Remote-first team
Performance-based bonus
AI Solutions QA Analyst
AI Solutions QA Analyst

McDermott • Washington

Remote
USD 93,000 - 142,000
Remote-first team
Competitive total rewards
Discretionary bonus eligibility
AI Solutions QA Analyst
AI Solutions QA Analyst

McDermott • Dallas (TX)

Remote
USD 93,000 - 142,000
Remote-first team
Competitive total rewards package
Performance-based bonuses
+1
AI Solutions QA Analyst
AI Solutions QA Analyst

McDermott • Wilmington (DE)

Remote
USD 93,000 - 142,000
AI Solutions QA Analyst
AI Solutions QA Analyst

McDermott • Austin (CO)

Remote
USD 93,000 - 142,000
Remote-first
Competitive total rewards
Performance-based bonuses
AI Solutions QA Analyst
AI Solutions QA Analyst

McDermott • Miami (FL)

Remote
USD 93,000 - 142,000
AI Solutions QA Analyst
AI Solutions QA Analyst

McDermott • Boston (MA)

Remote
USD 93,000 - 142,000
Remote-first team
Competitive total rewards
Discretionary bonuses
AI Solutions QA Analyst
AI Solutions QA Analyst

McDermott • Houston (TX)

Remote
USD 93,000 - 142,000
AI Solutions QA Analyst
AI Solutions QA Analyst

McDermott • Los Angeles (CA)

Remote
USD 93,000 - 142,000
Bonuses
Total rewards package
AI Solutions QA Analyst
AI Solutions QA Analyst

McDermott • San Diego (CA)

Remote
USD 93,000 - 142,000