Senior QA Engineer - AI & Automation Testing (Remote)

BruntWork

Metro Manila

Remote

PHP 750,000 - 1,100,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Permanent work from home
Immediate hiring
Health Insurance Coverage for eligible

Job summary

BruntWork is seeking a detail-oriented Senior QA Engineer (AI & Automation Testing) to join its technical team. You will evaluate LLMs, conversational flows, and system integrations, designing and executing tests to benchmark AI output quality across web and mobile platforms.

You will build automated UI and API tests, perform adversarial and safety testing, and integrate AI quality gates into CI/CD pipelines.

Qualifications

  • 4+ years of Software QA experience with both manual and automated testing.
  • Proven UI and API testing experience with automation tooling.
  • Strong scripting skills in Python or JavaScript.
  • Experience with CI/CD tools (GitHub Actions, GitLab CI, Jenkins).

Responsibilities

  • Test end-to-end conversational AI flows across web and mobile.
  • Evaluate AI responses for accuracy, relevance, tone, and hallucinations.
  • Perform adversarial and safety testing including prompt injections.
  • Design and execute regression tests for model/version updates.
  • Build and maintain automated UI and API testing frameworks.
  • Create benchmark datasets to track AI output quality.
  • Integrate AI quality checks into CI/CD pipelines.
  • Document AI-specific bugs and model drift with clear reproduction steps.

Skills

UI testing
API testing
Automation testing
Scripting in Python/JS
CI/CD familiarity
Communication & detail

Tools

Selenium
Playwright
Cypress
Postman
REST Assured
Python
JavaScript
GitHub Actions
GitLab CI
Jenkins

Job description

BruntWork is seeking a detail-oriented Senior QA Engineer (AI & Automation Testing) to join its technical team. You will evaluate LLMs, conversational flows, and system integrations, designing and executing tests to benchmark AI output quality across web and mobile platforms.

You will build automated UI and API tests, perform adversarial and safety testing, and integrate AI quality gates into CI/CD pipelines.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote QA Automation Engineer for AI & Software
Remote QA Automation Engineer for AI & Software

MuukTest • Mexico

Hybrid
PHP 3,701,418 - 5,552,127
20 days vacation
10 days PTO
Office setup grant $500
+1
Remote AI Sales Bot Tester & QA Analyst
Remote AI Sales Bot Tester & QA Analyst

BruntWork • Manila

Remote
PHP 3,185,000 - 5,732,000
Permanent work from home
Immediate hiring
Health Insurance Coverage for eligible
QA Automation Engineer (Remote)
QA Automation Engineer (Remote)

ETS Consulting, Inc. • Metro Manila

Remote
PHP 600,000 - 900,000
Senior QA Engineer — AI Platform, Enterprise-Grade Testing
Senior QA Engineer — AI Platform, Enterprise-Grade Testing

Blitzy • Boston

On-site
PHP 5,678,000 - 8,202,000
Senior QA Engineer: AI-Driven Testing Leader (Hybrid)
Senior QA Engineer: AI-Driven Testing Leader (Hybrid)

Beyond • Pateros

Hybrid
PHP 1,200,000 - 2,400,000
Medical Insurance
Hybrid work model
13th Month Pay
+1
Senior QA Engineer - Remote Automation & AI Testing
Senior QA Engineer - Remote Automation & AI Testing

Innodata Group • Central Visayas

On-site
PHP 900,000 - 1,200,000
Senior AI QA Engineer - Fintech & AI Testing Leader
Senior AI QA Engineer - Fintech & AI Testing Leader

Beyond • Taguig

Hybrid
PHP 1,200,000 - 2,100,000
13th Month Pay
Medical Insurance (employee + 2 depend
Sick Leave 15 days/year
+6
Senior QA Automation Engineer (Remote) - AI-Driven CI/CD
Senior QA Automation Engineer (Remote) - AI-Driven CI/CD

LegalMatch • Cebu City

Remote
PHP 900,000 - 1,800,000
AI Native QA Engineer
AI Native QA Engineer

White Cloak Technologies, Inc. • Makati

On-site
PHP 480,000 - 720,000
Senior QA Automation Engineer — AI-Driven Testing & CI/CD
Senior QA Automation Engineer — AI-Driven Testing & CI/CD

Software Directory • Philippines

Hybrid
PHP 1,339,000 - 2,120,000
Top locations