Data Integration Engineer — Real-Time Pipelines with Kafka

VirtueTech Recruitment Group; Greater London; On-site; GBP 70,000 - 100,000; Full time

Job summary

VirtueTech Recruitment Group is seeking a highly technical data integration engineer for a cross-asset trading house in London. You will design and implement ingestion, orchestration and distribution solutions using service-based and event-driven architectures, bridging data from bespoke platforms and external providers.

You will work with enormous data volumes and high-throughput streams, focusing on reliability, observability and real-time processing across data platforms and applications.

Qualifications

• Hands-on Apache Kafka expertise for enterprise-scale data integration.
• Experience designing API-led, event-driven and service-based integration solutions.
• Proficiency in Python and SQL for data engineering workloads.

Responsibilities

• Design, build and optimize large-scale data pipelines ingesting data from distributed sources.
• Implement resilient ingestion, orchestration and distribution services with observability.
• Work on throughput, latency, data consistency, and schema evolution in real-time systems.
• Collaborate across data, application and infrastructure layers to enable robust integrations.

Skills

Apache Kafka

Event-driven integration

Python

SQL

CI/CD

Observability

Distributed systems

Job description

VirtueTech Recruitment Group is seeking a highly technical data integration engineer for a cross-asset trading house in London. You will design and implement ingestion, orchestration and distribution solutions using service-based and event-driven architectures, bridging data from bespoke platforms and external providers.

You will work with enormous data volumes and high-throughput streams, focusing on reliability, observability and real-time processing across data platforms and applications.