AI QA Analyst II: Manual &Automation Testing

PraxisPro

New York (NY)

On-site

USD 85,000 - 120,000

Full time

28 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

PraxisPro is seeking a detail-oriented Quality Analyst II to join our small, fast-moving QA team. You’ll start with hands-on manual testing of our web and iOS apps across customer tenants while helping grow our automation coverage and working closely with engineering, product, and the AI team.

As automation matures, the role will move toward a balanced mix of manual and automated testing. You’ll log evidence-backed QA results in Jira, contribute to test plans, flag coverage gaps, and help ensure

Qualifications

  • 3+ years QA or similar role in software.
  • Knowledge of testing methodologies, tools, and processes.
  • Experience with test case management tools and Jira.

Responsibilities

  • Execute test cases from structured test matrices across web and iOS, covering new features, bug fixes, and customer-specific (tenant) releases
  • Run live voice roleplay sessions against AI healthcare professional personas (HCP’s) and evaluate whether persona behavior, conversation flow, scoring, and feedback meet requirements
  • Run platform and feature simulations to verify and validate performance and expected output
  • Judge AI output with rubric-based criteria rather than exact-match expectations, and determine whether an issue is a bug, expected behavior, or an enhancement
  • Write clear, evidence-backed QA results in Jira (pass/fail, steps to reproduce, session IDs, screenshots) that engineers and customer-facing teams can act on
  • Support regression testing and release-readiness checks, flagging high-risk areas to the team
  • Log well-reproduced bugs and retest fixes within sprint timelines
  • Contribute to test plans and matrices, and flag coverage gaps you notice along the way
  • Help build and extend our automated test suites (Playwright for web, Maestro for iOS), with automation becoming a larger part of your role over time

Skills

QA methods
Bug reporting
Test automation
Manual testing
Attention to detail

Tools

Jira
Playwright
Maestro for iOS

Job description

PraxisPro is seeking a detail-oriented Quality Analyst II to join our small, fast-moving QA team. You’ll start with hands-on manual testing of our web and iOS apps across customer tenants while helping grow our automation coverage and working closely with engineering, product, and the AI team.

As automation matures, the role will move toward a balanced mix of manual and automated testing. You’ll log evidence-backed QA results in Jira, contribute to test plans, flag coverage gaps, and help ensure

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Quality Analyst II
Quality Analyst II

PraxisPro • New York (NY)

On-site
USD 85,000 - 120,000
QA Analyst II - AI & Life Sciences, On-site NY
QA Analyst II - AI & Life Sciences, On-site NY

PraxisPro Inc. • New York (NY)

On-site
USD 85,000 - 105,000
QA Analyst II: AI API UI Testing
QA Analyst II: AI API UI Testing

Verisk Analytics, Inc. • Jersey City (NJ)

On-site
USD 80,000 - 110,000
Senior QA Analyst | AI-Driven Testing & SDLC Expert
Senior QA Analyst | AI-Driven Testing & SDLC Expert

AI AXISS INC • Ohio

Hybrid
USD 90,000 - 120,000
Remote QA Automation Specialist (AI & Manual Testing)
Remote QA Automation Specialist (AI & Manual Testing)

People Solutions • United States

Remote
USD 65,000 - 95,000
Senior QA Analyst: AI-Driven Testing & Data QA
Senior QA Analyst: AI-Driven Testing & Data QA

I3 INFOTEK INC • Mason (OH)

On-site
USD 90,000 - 120,000
AI-Driven QA Analyst (Mid/Senior)
AI-Driven QA Analyst (Mid/Senior)

Ciandt • United States

Remote
USD 70,000 - 110,000
Health and dental insurance
Meal and food allowance
Childcare assistance
+9
QA Engineer: AI-Augmented Manual & Automation (Remote)
QA Engineer: AI-Augmented Manual & Automation (Remote)

Mantra Digital • United States

Remote
USD 16,000 - 18,000
QA Automation Engineer | AI-Powered Testing at Scale
QA Automation Engineer | AI-Powered Testing at Scale

Productiv Teams • United States

Remote
USD 70,000 - 110,000
Senior QA Engineer: AI-Driven Testing & Quality Champion
Senior QA Engineer: AI-Driven Testing & Quality Champion

Ciandt • United States

Remote
USD 70,000 - 110,000
Health and dental insurance
Meal/food allowance
Continuous learning (CI&T University)
+1