QA Engineer with AI

Saransh Inc; Jersey City (NJ); Remote; USD 55,000 - 83,000; Part time

Job summary

Saransh Inc. is hiring a QA Tester with AI & Application Testing to ensure the quality of AI model outputs and web/app functionality. This remote role focuses on validation of data accuracy, business logic, and system performance within a 6-month contract.

You will design and execute test plans, create automated tests for APIs and UI where appropriate, and triage defects with engineers to drive release readiness and continuous improvement in testing practices.

Qualifications

• 4+ years in QA/Test Engineering for web/services-based applications.
• Experience with test automation tools (Selenium) and API testing (Postman or similar).
• Strong understanding of test case design, defect lifecycle, and agile QA practices.
• Familiarity with tracking tools (JIRA) and test documentation.
• Ability to reason about data quality and validate outputs against requirements.

Responsibilities

• Design and execute test plans covering AI model outputs, data correctness, and application functionality.
• Create automated tests for APIs and UI where appropriate; maintain regression suites.
• Validate business logic, edge cases, and non-functional requirements (performance, reliability).
• Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).
• Triage defects, document reproducible steps, and partner with engineers to resolve issues.
• Contribute to release readiness, quality gates, and continuous improvement of testing practices.

Skills

Test case design

Agile QA practices

Manual testing

Tools

Selenium

Postman

JIRA

Job description

Position Title: QA Tester with AI & Application Testing
Location: Remote
Duration: 6 Months Contract

Core Skills:

• Selenium, Postman, Test Cases, JIRA, Manual Testing.

Role Summary:

Tests AI model outputs and application functionality. Validates data accuracy, business logic, and system performance.

Key Responsibilities:

• Design and execute test plans covering AI model outputs, data correctness, and application functionality.
• Create automated tests for APIs and UI where appropriate; maintain regression suites.
• Validate business logic, edge cases, and non-functional requirements (performance, reliability).
• Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).
• Triage defects, document reproducible steps, and partner with engineers to resolve issues.
• Contribute to release readiness, quality gates, and continuous improvement of testing practices.

Required Qualifications:

• 4+ years in QA/Test Engineering for web/services-based applications.
• Experience with test automation tools (Selenium) and API testing (Postman or similar).
• Strong understanding of test case design, defect lifecycle, and agile QA practices.
• Familiarity with tracking tools (JIRA) and test documentation.
• Ability to reason about data quality and validate outputs against requirements.

Preferred Nice to have:

• Experience testing ML/LLM systems: evaluation datasets, prompt regressions, safety checks.
• Performance testing experience (load, stress) and observability basics.
• Knowledge of accessibility testing for UI.