Hybrid Data Engineer for Credit Bureau Cloud Pipelines

Creditsafe; Cardiff; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Competitive salary

Company laptop

Bonus scheme

25 days annual leave

Hybrid working model

Healthcare & company pension

E-learning and career development

Job summary

Creditsafe is building a new Consumer Bureau in the UK. We seek a Data Engineer experienced with cloud-native systems to drive data pipelines, quality, and scalability. You will work with Python, Spark, Airflow, and AWS technologies to deliver real-time and batch solutions.

Join a collaborative team focused on high throughput, low latency data delivery and data quality, with opportunities for mentoring and leadership across engineering disciplines.

Qualifications

• You understand data engineering best practices.
• You write clean and efficient code and leverage the cloud for performance.
• 6+ years of development experience building production-grade data pipelines in Python.
• You enjoy solving problems and collaborating with teammates to deliver robust solutions.
• Excellent communication and ability to explain viewpoints clearly to the team.

Responsibilities

• Contribute actively to the codebase and participate in peer reviews.
• Design and build a metadata-driven, event-based distributed data processing platform using Python, Spark, Airflow, Iceberg, DynamoDB, AWS Glue, S3.
• Play an active role in design, development, and deployment of the business-critical system.
• Build and scale Creditsafe’s data pipelines with batch and streaming approaches and sub-500ms latency.
• Understand domain data to make recommendations to improve the product.
• Utilise AI tools to assist in all aspects of work.

Skills

Data engineering

Python

Cloud platforms

Problem solving

Team collaboration

Tools

Python

Apache Spark

Apache Airflow

Iceberg

DynamoDB

AWS

S3

Kinesis

Job description

Creditsafe is building a new Consumer Bureau in the UK. We seek a Data Engineer experienced with cloud-native systems to drive data pipelines, quality, and scalability. You will work with Python, Spark, Airflow, and AWS technologies to deliver real-time and batch solutions.

Join a collaborative team focused on high throughput, low latency data delivery and data quality, with opportunities for mentoring and leadership across engineering disciplines.