AI QA Engineer: On‑Device & Mobile Testing (Hybrid)

Svitla; Greater London; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Flexible workspace (remote or office)

Bonuses for talks and writing

Generous time off

Job summary

Svitla Systems Inc. is seeking an AI QA Engineer – On-Device & Mobile Testing for a full-time role in London. You will design evaluation strategies for AI/ML models, perform edge-case testing on real Android devices, and drive improvements across the development lifecycle.

Responsibilities include benchmarking, data curation, red-teaming, automated validation, and producing clear insights for stakeholders. Office visits approx. three times weekly with flexible work arrangements.

Qualifications

• Proven experience in QA, preferably AI/ML.
• Deep understanding of ML lifecycle and AI failure modes.
• Proactive data collection and validation for edge cases.
• Hands-on with UI automation frameworks (Playwright/Cypress/Robot Framework/Selenium/WebdriverIO).
• Experience with mobile test automation (Appium).
• API testing experience (Postman).
• Testing on real Android devices, not only emulators.
• Strong analytical and problem-solving skills with attention to detail.
• Experience with Jira and test case management tools.
• Familiarity with AI tooling to create agents and testing code.

Responsibilities

• Design, develop, and maintain test suites and evaluation benchmarks for AI models.
• Conduct error analysis, triage defects, and prioritize fixes with the dev team.
• Source and curate high-quality datasets for model evaluation and testing.
• Perform exploratory and adversarial testing to uncover unexpected model behaviors.
• Validate AI-powered applications and APIs with automated tests.
• Set up and troubleshoot evaluation environments and pipelines.
• Synthesize test results into clear, actionable reports for stakeholders.
• Contribute to post-hoc reviews and continuous testing process improvements.

Skills

AI QA

ML lifecycle

Data validation

UI automation

Appium

Android testing

API testing

Jira

Test case mgmt

AI tooling

Tools

Playwright

Cypress

Robot Framework

Selenium

WebdriverIO

Job description

Svitla Systems Inc. is seeking an AI QA Engineer – On-Device & Mobile Testing for a full-time role in London. You will design evaluation strategies for AI/ML models, perform edge-case testing on real Android devices, and drive improvements across the development lifecycle.

Responsibilities include benchmarking, data curation, red-teaming, automated validation, and producing clear insights for stakeholders. Office visits approx. three times weekly with flexible work arrangements.