Senior QA Engineer for AI & LLM Testing

Tellent

Netherlands

Hybrid

EUR 70,000 - 100,000

Full time

6 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Hybrid or remote setup across Europe

Annual training budget

Pension plan

Travel reimbursement

Wellness perks

28 paid holiday days + 2 extra days

Work from anywhere 4 weeks/year

MacBook and top-tier tooling

Home office budget €200

Job summary

Tellent is seeking a Senior Quality Engineer for Tellent Intelligence (AI) to own and grow QA for AI-powered features. You will expand Playwright test coverage and help shape testing strategies for prompts, models, and safety, delivering reliable experiences for customers.

You will collaborate with AI engineers and developers, build robust automation, define quality metrics, and drive improvements to our AI testing framework across the product. Hybrid/remote EU role with strong growth.

Qualifications

Several years of quality engineering experience on complex web apps.
Experience testing AI-powered apps, LLM-based products, or ML systems is a plus.
End-to-end automation expertise with Playwright.
Experience testing APIs and backend services.
Ability to discuss product behaviour and technical detail.
Understanding AI testing challenges such as prompts, hallucinations, bias, and safety.
Analytical mindset for defining quality expectations in variable outputs.
Fluent English; Polish is a plus.

Responsibilities

Collaborate with QE teams to implement test automation across the Tellent Intelligence domain.
Embed quality early with developers and AI engineers, sharing practices.
Design and execute test plans and automated suites across frontend, backend, and AI features.
Develop domain expertise to guide quality decisions in AI features.
Define testing strategies for AI outputs, ensuring safety and relevance.
Create evaluation datasets and benchmarks for non-deterministic AI systems.
Validate prompt changes, AI agent behavior, and safety guardrails.
Improve AI quality evaluation practices and testing frameworks.