Senior Data Engineer — Hybrid, Growth & Data Platform Lead

Creditsafe Group; Dublin; Hybrid; EUR 90,000 - 120,000; Full time

Benefits offered by this job

Bonus Scheme

Cycle to work and Wellbeing Programme

Global company gatherings and events

E-learning and career progression

Job summary

Creditsafe is expanding its Consumer Bureau with a Data Engineer who will join a team of highly skilled engineers building Creditsafe’s new data platform. You will work on data quality, lineage, and auditability, using AWS technologies like S3, Iceberg, Aurora, DynamoDB, Lambda, Fargate, ECS, Airflow, Spark, and Python-based processing pipelines.

You will help deliver fast, scalable APIs for clients. The role emphasizes end-to-end ownership, production-grade data pipelines, and mentoring

Qualifications

• Experience designing metadata-driven, event-based data platforms.

Responsibilities

• Actively contribute to the codebase and peer reviews.
• Design and build metadata driven, event based distributed data processing platform using Python, Spark, Airflow, Iceberg, DynamoDB, AWS Glue, S3.
• Build and scale data pipelines for sub-100ms latency serving.
• Understand domain data to improve product.
• Leverage AI tools to aid in work.

Skills

Data engineering

Python programming

Communication skills

Tools

Python

Spark

Airflow

Iceberg

DynamoDB

AWS Glue

S3

Athena

Redshift

Lambda

API Gateway

Terraform

CI/CD

Job description

Creditsafe is expanding its Consumer Bureau with a Data Engineer who will join a team of highly skilled engineers building Creditsafe’s new data platform. You will work on data quality, lineage, and auditability, using AWS technologies like S3, Iceberg, Aurora, DynamoDB, Lambda, Fargate, ECS, Airflow, Spark, and Python-based processing pipelines.

You will help deliver fast, scalable APIs for clients. The role emphasizes end-to-end ownership, production-grade data pipelines, and mentoring