AI Solutions QA Analyst

SNI Technology; United States; Remote; USD 90,000 - 120,000; Full time

Job summary

SNI Technology is seeking an AI Solutions QA Analyst to own the full quality lifecycle for AI-powered solutions in a remote role. You will design tests for complex data-driven systems, implement automated pipelines in Azure DevOps, and work closely with product analysts and engineers to ensure production-ready quality.

The ideal candidate has 4+ years in Quality Assurance, strong experience in manual and automated testing, and a Bachelor’s degree in CS/IS/Engineering.

Qualifications

• Experience across the full testing lifecycle in QA roles.
• Ability to design tests for complex data-driven systems including edge cases.
• Experience integrating automated test suites into CI/CD pipelines.

Responsibilities

• Own the end-to-end QA lifecycle for AI-powered solutions, including unit, integration, system, regression, performance, and scalability testing.
• Partner with Analysts to design and evaluate test cases using AI-assisted tools, focusing on boundary conditions and edge cases.
• Collaborate with engineering teams to build and integrate automated test suites into Azure DevOps CI/CD pipelines.
• Define and execute system-level QA strategies in collaboration with QA leadership.
• Translate security requirements into solution-specific test scenarios with security teams.
• Promote a quality-first culture by embedding testing throughout the development lifecycle.

Skills

Quality Assurance

Unit testing

Integration testing

System testing

Regression testing

Manual testing

Automated testing

CI/CD

Azure DevOps

Performance testing

AI/ML testing

Education

Bachelor's degree in Computer Science / Information Systems / Engineering

Tools

Azure DevOps

Job description

Location - Remote, but candidates must reside near one of the following metro areas:

Boston, New York, Wilmington, Washington, DC, Atlanta, Miami, Boca Raton, Chicago, Austin, Houston, Nashville, Dallas, Los Angeles, San Francisco, Silicon Valley, or San Diego.

About the Opportunity

A forward-thinking organization is building one of the most ambitious AI programs in its industry — where quality is a core driver of success, not an afterthought.

As AI-powered solutions are deployed across business and operational teams, we are seeking an AI Solutions QA Analyst to own the full quality lifecycle. This role will ensure every solution released is thoroughly tested, highly reliable, and production-ready, leveraging modern QA methodologies and AI-assisted tools to move faster and more effectively than traditional testing approaches.

This is a high-impact role working directly with product analysts, engineers, and QA leadership to shape how AI quality is defined and delivered in a cutting-edge environment.

What You’ll Do

• Own the end-to-end QA lifecycle for AI-powered solutions, including:
• Unit, integration, system, regression, performance, and scalability testing
• Partner with Analysts to design and evaluate test cases using AI-assisted tools, with a focus on:
• Boundary conditions
• Edge cases
• Collaborate with engineering teams to build and integrate automated test suites into Azure DevOps CI/CD pipelines
• Define and execute system-level QA strategies in collaboration with QA leadership
• Translate security requirements into solution-specific test scenarios alongside security teams
• Reliability
• Consistency
• Stability across diverse real-world inputs
• Test cases
• Quality metrics and reporting
• Promote a quality-first culture by embedding testing throughout the development lifecycle rather than treating it as a final checkpoint

What We’re Looking For

• 4+ years of experience in Quality Assurance, including hands-on test execution across the full testing lifecycle
• Strong experience with:
• Unit, integration, system, and regression testing
• Both manual and automated testing approaches
• Proven ability to design tests for complex, data-driven systems, including edge cases and boundary conditions
• Experience integrating automated test suites into CI/CD pipelines (Azure DevOps strongly preferred)
• Familiarity with performance and scalability testing concepts; experience with load testing tools is a plus
• Strong working knowledge of:
• QA metrics and reporting
• Demonstrated analytical mindset, with the ability to evaluate unpredictable or emerging system behaviors (e.g., AI outputs)
• Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent experience

Preferred Qualifications

• Experience testing AI-powered applications, including:
• LLM-integrated systems
• Agent-based architectures
• Familiarity with AI-assisted testing tools and automated test generation
• Exposure to security testing practices in collaboration with dedicated security teams
• Experience working in regulated environments (e.g., legal, financial services)
• Knowledge of Azure DevOps, including pipeline configuration and automated test integration