Senior QA Engineer — AI & Feature Testing

Solvd; United States; Remote; USD 110,000 - 160,000; Full time

Job summary

Solvd Inc. is seeking a Senior QA Engineer to own quality for AI-powered and traditional features across web, mobile, and API for a leading personal finance platform. You will focus on testing AI/LLM-integrated components and ensure robust validation in production environments.

The role requires deep experience in eval-based and deterministic testing, Playwright, and strong QA practices. You will work with a global team and align LATAM hours to collaborate effectively.

Qualifications

• 5–7 years of experience in software testing across web, mobile, and API.
• Hands-on experience with Playwright in a production testing environment.
• Hands-on AI feature testing experience validating AI/LLM-integrated products.
• Clear understanding of eval vs. deterministic testing and human-in-the-loop evaluations.
• Strong understanding of web and mobile app development lifecycles including iOS and Android.
• Proven experience in integration, regression, performance/load, and UAT.
• Hands-on knowledge of browser DevTools and log monitoring.
• Experience with test management systems (e.g., Jira, Confluence).
• Experience with HTML proxy tools like Charles Proxy or Fiddler.

Responsibilities

• Plan, design, and execute test cases for AI-powered and traditional features.
• Analyze AI model behavior specs, prompts, and edge-case scenarios.
• Convert requirements into test plans, cases, and scripts.
• Perform manual feature testing across platforms and verify fixes.
• Create clear defect reports and document AI outputs and regressions.
• Develop QA practices for emerging technologies and share best practices.
• Become a subject matter expert in core systems and reports.
• Collaborate with engineers, IT, and global teams with LATAM hours.

Skills

Playwright

AI testing

Eval vs deterministic testing

Web/mobile/API testing

Defect reporting

Browser DevTools

Test management

Education

Bachelor’s degree in Computer Science

Tools

Jira

Confluence

Charles Proxy

Fiddler

Xcode logs

ADB logs

Job description

Solvd Inc. is seeking a Senior QA Engineer to own quality for AI-powered and traditional features across web, mobile, and API for a leading personal finance platform. You will focus on testing AI/LLM-integrated components and ensure robust validation in production environments.

The role requires deep experience in eval-based and deterministic testing, Playwright, and strong QA practices. You will work with a global team and align LATAM hours to collaborate effectively.