AI QA Analyst: Validate & Elevate AI Solutions

MCI

United States

On-site

USD 90,000 - 120,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

MCI in the United States is seeking an AI Tester / AI QA Analyst to ensure the quality, reliability, and effectiveness of AI-powered products, machine learning models, and Generative AI applications. This role validates AI functionality and identifies defects across multiple use cases.

You will design and execute testing strategies, document results, and work closely with AI engineers and product managers to improve quality across the development lifecycle.

Qualifications

  • Bachelor's degree in Information Technology, Computer Science, Quality Assurance, Engineering, or a related field.
  • Minimum 3 years of software testing, QA, or technology-related experience.
  • Experience creating and executing test plans and test cases.
  • Strong analytical and troubleshooting skills.
  • Experience documenting defects and test outcomes.
  • Understanding of software development lifecycle methodologies.
  • Familiarity with AI, machine learning, or Generative AI concepts.
  • Strong attention to detail.
  • Ability to analyze large volumes of information and identify patterns.
  • Strong written and verbal communication skills.
  • Experience working within Agile environments.
  • Ability to collaborate effectively with technical teams.

Responsibilities

  • Ensure AI systems perform as expected across multiple use cases.
  • Design and execute AI testing strategies and test cases.
  • Validate model outputs against expected outcomes.
  • Assess system reliability, consistency, and performance.
  • Identify defects, anomalies, and areas for improvement.
  • Support the delivery of high-quality AI solutions.
  • Conduct functional, regression, and user acceptance testing.
  • Verify compliance with business and regulatory requirements.
  • Maintain testing documentation and evidence.
  • Support release readiness assessments.
  • Work closely with technical and business teams.
  • Collaborate with AI engineers and product managers.
  • Participate in requirements and solution reviews.
  • Provide feedback throughout the development lifecycle.
  • Support continuous quality improvement initiatives.
  • Help advance AI testing practices across the organization.
  • Evaluate new AI testing methodologies and tools.
  • Recommend enhancements to quality frameworks.
  • Stay informed about AI and Generative AI developments.
  • Contribute to best practices and standards.

Skills

QA testing
Analytical thinking
Agile
Documentation
Collaboration
Communication

Education

Bachelor's degree in IT or CS

Tools

QA automation tools

Job description

MCI in the United States is seeking an AI Tester / AI QA Analyst to ensure the quality, reliability, and effectiveness of AI-powered products, machine learning models, and Generative AI applications. This role validates AI functionality and identifies defects across multiple use cases.

You will design and execute testing strategies, document results, and work closely with AI engineers and product managers to improve quality across the development lifecycle.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Quality Assurance Engineer — Automation & Reliability
AI Quality Assurance Engineer — Automation & Reliability

Aquent • Ann Arbor (MI)

On-site
USD 110,000 - 150,000
Subsidized health plan
Vision plan
Dental plan
+1
AI QA Engineer - Automate, Validate & Scale AI
AI QA Engineer - Automate, Validate & Scale AI

Aquent Talent • Ann Arbor (MI)

On-site
USD 120,000 - 150,000
Health insurance
Vision plan
Dental plan
+3
AI Tester / AI QA Analyst
AI Tester / AI QA Analyst

MCI • United States

On-site
USD 90,000 - 120,000
AI QA Engineer for Reliable, Scalable AI Solutions
AI QA Engineer for Reliable, Scalable AI Solutions

Skill • Ann Arbor (MI)

On-site
USD 57,859 - 64,747
AI Evaluation QA Engineer — ML Testing & Validation
AI Evaluation QA Engineer — ML Testing & Validation

Intellias • Town of Poland (NY)

On-site
USD 120,000 - 160,000
AI Quality Engineering Lead
AI Quality Engineering Lead

Mastercard • O’Fallon (MO)

On-site
USD 140,000 - 231,000
Annual bonus
401k match
Generous leave
+1
AI Quality Engineer: End-to-End ML & Data Validation
AI Quality Engineer: End-to-End ML & Data Validation

Cavendish Professionals • Town of Italy (NY)

On-site
USD 95,000 - 120,000
QA Engineer - AI & Data (ML Model Validation)
QA Engineer - AI & Data (ML Model Validation)

CXApp • San Ramon (CA)

On-site
USD 80,000 - 120,000
Competitive salary
Performance-based bonuses
Comprehensive health plans
+5
AI QA Engineer: Agentic Testing & AI-Driven Automation
AI QA Engineer: Agentic Testing & AI-Driven Automation

American Society for Quality • Bogota (NJ), Northern (KY)

Hybrid
USD 110,000 - 170,000
AI QA Engineer: Automation & AI Testing
AI QA Engineer: Automation & AI Testing

United States Digital Space LLC • United States

Remote
USD 77,000 - 118,000