Remote AI Content QA Analyst — 4-Month Contract

Microsoft; Redmond (WA); On-site; USD 47,000 - 54,000; Full time

Benefits offered by this job

Medical, dental & vision

401(k) Retirement Plan – Pre-tax and G

Life Insurance (Company paid)

Disability insurance

HSA & DCFSA

Employee Assistance Program

Time Off/Leave

Job summary

Microsoft is seeking a detail-oriented Content QA Analyst to ensure quality across Microsoft 365 content experiences, including templates and Copilot features. This contract role collaborates with Allegis Global Solutions and focuses on rigorous testing of content, usability, and design fidelity.

You will develop test plans, execute manual and automated tests, evaluate AI-generated outputs, and provide actionable recommendations to improve both customer experience and content quality.

Qualifications

• 2–4 years of QA, content testing, usability testing, or quality assurance.
• Experience creating test plans, test cases, and test reports.
• Scripting experience in Python or PowerShell.
• Knowledge of Microsoft 365 products and productivity workflows.
• Experience testing AI-generated content or generative AI.
• Understanding of design principles, content quality, and UX.
• Experience with automation frameworks.
• Familiarity with human evaluation methodologies and quality rubrics.
• Strong analytical and problem-solving skills.
• Excellent written and verbal communication.

Responsibilities

• Develop and execute test plans for templates and AI-generated content.
• Perform manual and automated testing across Word, Excel, PowerPoint, Create, and Copilot.
• Validate content quality, usability, accessibility, and design fidelity.
• Identify, document, reproduce, and track defects to resolution.
• Evaluate AI-generated outputs against defined quality standards.
• Assess content accuracy, relevance, usability, formatting, and customer experience.
• Provide recommendations to improve model and content performance.
• Create and maintain test scripts, test cases, and validation docs.
• Develop repeatable testing approaches for new content features.
• Partner with content and cross-team stakeholders to identify automation opportunities.
• Analyze test results and communicate findings to stakeholders.
• Track testing outcomes and keep docs in sync with content workflows.

Skills

QA experience

Testing methodologies

Content testing

Automation awareness

Education

Bachelor's degree in Content Automation, Computer Science, Engineering, Information Systems, or related field

Tools

Python

PowerShell

Job description

Microsoft is seeking a detail-oriented Content QA Analyst to ensure quality across Microsoft 365 content experiences, including templates and Copilot features. This contract role collaborates with Allegis Global Solutions and focuses on rigorous testing of content, usability, and design fidelity.

You will develop test plans, execute manual and automated tests, evaluate AI-generated outputs, and provide actionable recommendations to improve both customer experience and content quality.