QA Engineer: Kafka & Large-Scale Data Pipelines (Remote UK)

VIQU IT; Greater London; À distance; GBP 70 000 - 120 000; Plein temps

Résumé du poste

VIQU IT in the United Kingdom is seeking a specialist to test large-scale Kafka streaming and batch data pipelines, collaborating with data engineers to ensure data integrity across ingestion, transformation and output.

You will design an automated regression suite to run on every release, write a test strategy from scratch, and contribute to formal documentation while operating in a small, high-standards team on a remote, national basis.

Qualifications

• Kafka experience with topics, partitions, consumer groups, offsets, replay and schema registry.
• Experience testing high-volume ETL/ELT data pipelines at scale (millions of rows per day).
• Experience writing a test strategy and assessing streaming data risk.
• Experience with REST, contract testing and schema validation.
• Experience with automated regression testing in CI.
• Comfort working with data engineers and building tooling for testing at pipeline level.
• Strong Python and SQL skills.
• Structured, evidence-led approach with defined criteria, traceability and documentation.
• Ability to work in a small team with high standards and loose boundaries.
• SC clearance or eligibility; active clearance preferred.

Responsabilités

• Test large-scale Kafka streaming and batch data pipelines (ingestion, transformation, reconciliation, output).
• Build test harnesses with data engineers to enable end-to-end system testing at scale.
• Prove correctness, completeness and integrity across very large data volumes.
• Design and build an automated regression suite to run on every release and verify accuracy, stability and response times.
• Write the test strategy for the programme from scratch.
• Prepare formal test documentation for defence factory assurance with tested criteria and milestones.
• Work hands-on as part of a small, multidisciplinary team, including engineering leadership support.

Connaissances

Kafka

Python

SQL

REST

CI

Test strategy

SC clearance

Outils

CI/CD

Schema registry

Description du poste

VIQU IT in the United Kingdom is seeking a specialist to test large-scale Kafka streaming and batch data pipelines, collaborating with data engineers to ensure data integrity across ingestion, transformation and output.

You will design an automated regression suite to run on every release, write a test strategy from scratch, and contribute to formal documentation while operating in a small, high-standards team on a remote, national basis.