AI QA Engineer — Remote (EU/UK) with LLM Testing

develop; España; Remote; EUR 60.000 - 100.000; Vollzeit

Zusammenfassung

develop is seeking an AI QA Engineer to own quality across AI testing, functional and non-functional areas in a fully remote setup spanning the EU and UK. You’ll craft automation with Playwright or Cypress, test AI/LLM features, and drive quality metrics across the product.

Ideal candidates bring strong QA foundations, performance testing, CI/CD, API testing and professional English. You’ll influence engineering and product teams and help shape the testing framework for an AI-powered cloud

Qualifikationen

• Strong QA foundations across test planning, functional, regression and exploratory testing.
• Practical experience or strong working knowledge of AI/LLM testing, including hallucination, consistency, safety and latency.
• Strong automation experience with Playwright, Cypress or similar, using TypeScript or Python.
• Hands-on experience with performance/load testing and CI/CD integration.
• Understanding of LLM evaluation frameworks and AI quality metrics.
• Experience with API testing, microservices and cloud-native environments.
• A quality ownership mindset and ability to influence engineering and product teams.
• Professional level of English speaking.

Aufgaben

• Own quality strategy across functional, non-functional and AI testing.
• Build automated performance, load and stress testing using tools such as JMeter, k6 or Gatling.
• Develop and contribute to LLM/AI evaluation frameworks, assessing accuracy, hallucination, relevance, safety and other quality metrics.
• Test AI and agentic behaviours, including non-deterministic outputs, prompts, model regressions and guardrails.
• Champion shift-left and continuous testing across engineering and product.
• Establish quality metrics, observability and production quality signals.
• Use AI-assisted tools to improve testing efficiency and coverage.

Kenntnisse

QA testing

AI/LLM testing

Automation

CI/CD

API testing

Performance testing

Influence teams

English proficiency

Tools

Playwright

Cypress

JMeter

k6

Gatling

DeepEval

RAGAS

Jobbeschreibung

develop is seeking an AI QA Engineer to own quality across AI testing, functional and non-functional areas in a fully remote setup spanning the EU and UK. You’ll craft automation with Playwright or Cypress, test AI/LLM features, and drive quality metrics across the product.

Ideal candidates bring strong QA foundations, performance testing, CI/CD, API testing and professional English. You’ll influence engineering and product teams and help shape the testing framework for an AI-powered cloud