Senior Data Platform Engineer - Compliance & Streaming

eFinancialCareers; Chester; Hybride; GBP 90 000 - 120 000; Plein temps

Résumé du poste

eFinancialCareers seeks a Software / Data Engineer for Compliance Assurance & Streaming Data in Chester on a hybrid basis. You will own end-to-end data platform engineering—ingestion, processing, and auditable controls for large-scale financial data.

Responsibilities include building resilient pipelines, integrating vendor APIs, and delivering production-grade, compliant solutions across distributed systems.

Qualifications

• Strong Python development in enterprise environments.
• Experience with Spark/PySpark for large-scale data processing.
• Proficiency with Apache Kafka and real-time streaming patterns.
• Experience with NiFi, Hadoop, Hive and SQL for data processing and storage.

Responsabilités

• Design and build resilient, enterprise-scale data pipelines.
• Integrate across vendor APIs, streaming tech and distributed data platforms.
• Engineer high-volume batch and near real-time processing solutions.
• Develop reusable ingestion and processing frameworks.
• Develop robust data handling patterns including replay, backfill, recoverability and schema evolution
• Define and enhance operational telemetry, monitoring and platform observability
• Deliver solutions through CI/CD pipelines and production environments

Connaissances

Python development

Apache Spark / PySpark

Apache Kafka

Apache NiFi

Hadoop

Advanced SQL

REST API integration

Data modelling

Distributed systems engineering

CI/CD

Git workflows

Outils

Hive

Spark

Kafka ecosystem tooling

NiFi

Python tooling

Description du poste

eFinancialCareers seeks a Software / Data Engineer for Compliance Assurance & Streaming Data in Chester on a hybrid basis. You will own end-to-end data platform engineering—ingestion, processing, and auditable controls for large-scale financial data.

Responsibilities include building resilient pipelines, integrating vendor APIs, and delivering production-grade, compliant solutions across distributed systems.