AI QA Engineer - Remote, Flexible Hours & Growth

Hoorya

Australia

Remote

AUD 110,000 - 160,000

Full time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
Flexible hours
Remote-first mode
Vacation/leave

Job summary

Innovecs is a global digital services company supporting AI quality engineering across multiple regions, including Australia. The role focuses on designing and executing QA strategies for AI-powered warehouse assistants, validating RAG and AI-specific failure modes, and building scalable test automation suites.

Candidates should have 5+ years in QA, 2+ years with AI-enabled apps, strong coding skills, and experience with Playwright/Selenium/Cypress, CI/CD, and cloud platforms.

Qualifications

  • 5+ years of experience in Quality Assurance and Test Automation.
  • 2+ years of experience testing AI-enabled applications, LLM solutions, or agentic systems.
  • Strong Python/Java/JavaScript skills.
  • Experience with Playwright, Selenium, Cypress, or similar automation frameworks.
  • Experience with API, integration, and database testing.
  • Experience with CI/CD pipelines and DevOps practices.
  • Understanding of AI-specific failure modes: hallucinations, prompt injection, jailbreak attacks, model drift, bias and fairness issues, RAG failures.
  • Experience working in cloud-native environments (Azure or AWS).
  • Experience with LangSmith, Braintrust, MLflow, Arize, or Evidently AI.

Responsibilities

  • Design and execute quality strategies for AI-powered warehouse assistants, copilots, and autonomous agents.
  • Build evaluation frameworks for LLM-based warehouse workflows and agentic systems.
  • Perform hallucination, factuality, grounding, and response-quality testing.
  • Validate RAG implementations and retrieval accuracy.
  • Conduct adversarial testing, prompt injection testing, and jailbreak assessments.
  • Create and maintain scalable automation frameworks for functional, API, integration, and end-to-end testing.
  • Design CI/CD quality gates for AI and non-AI releases.
  • Support compliance with EU AI Act, ISO 42001, and responsible AI principles.

Skills

Quality Assurance
AI testing
Python/Java/JavaScript
Playwright/Selenium/Cypress
API/Integration testing
CI/CD/DevOps
AI failure modes
Cloud environments
LangSmith/Braintrust/Evidently AI

Tools

Playwright
Selenium
Cypress
API testing
SQL/DB testing
Azure/AWS
MLflow/Arize

Job description

Innovecs is a global digital services company supporting AI quality engineering across multiple regions, including Australia. The role focuses on designing and executing QA strategies for AI-powered warehouse assistants, validating RAG and AI-specific failure modes, and building scalable test automation suites.

Candidates should have 5+ years in QA, 2+ years with AI-enabled apps, strong coding skills, and experience with Playwright/Selenium/Cypress, CI/CD, and cloud platforms.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior QA Automation Engineer - Flexible Work & AI Testing
Senior QA Automation Engineer - Flexible Work & AI Testing

Reapit • Australia

Hybrid
AUD 120,000 - 170,000
AI QA Automation Lead: Scale Testing with AI
AI QA Automation Lead: Scale Testing with AI

EPAM Systems • Sydney

On-site
AUD 140,000 - 200,000
Senior QA Engineer - AI-Powered Automation, Remote AU
Senior QA Engineer - AI-Powered Automation, Remote AU

Think Wink • Melbourne

Remote
AUD 90,000 - 120,000
Senior AI QA Automation Architect (Presales)
Senior AI QA Automation Architect (Presales)

EPAM Systems • Australia

On-site
AUD 140,000 - 200,000
Remote Software QA Engineer – AI-Driven Testing
Remote Software QA Engineer – AI-Driven Testing

The Probe Group • Melbourne

Remote
AUD 90,000 - 120,000
Remote work
Flexible schedule
QA/Test Engineer - AI Platform Infra (Remote)
QA/Test Engineer - AI Platform Infra (Remote)

Sharon AI, Inc • Sydney

Remote
AUD 90,000 - 130,000
Remote work from home
Birthday leave
Employee Assistance Program (EAP)
+4
AI Software QA Engineer - Test Automation & Quality
AI Software QA Engineer - Test Automation & Quality

AI Talent • Sydney

On-site
AUD 70,000 - 120,000
Qa Engineer
Qa Engineer

Think Wink • Melbourne

Remote
AUD 90,000 - 120,000
Remote Automotive QA & AI Training Specialist
Remote Automotive QA & AI Training Specialist

Mindrift • Australia

Remote
AUD 43,187 - 61,509
Flexible working hours
Competitive pay based on expertise
Value-adding projects
Senior AI Test Engineer
Senior AI Test Engineer

Clicks IT Recruitment • Brisbane

Hybrid
AUD 110,000 - 140,000
Top locations