Data Engineer

Creditsafe; Dublin; On-site; EUR 60,000 - 80,000; Full time

Benefits offered by this job

Bonus Scheme

E-learning opportunities

Global company gatherings

Company Laptop

Job summary

Creditsafe is seeking a Quality Engineer to help develop a cloud-native data processing platform. You will be responsible for writing clean Python code, building distributed systems, and contributing to an agile development team.

The ideal candidate will have at least 6 years of experience and strong skills in data engineering practices. Join us at our Dublin office and become part of a collaborative and innovative team focused on delivering quality solutions.

Qualifications

• Minimum 6 years of development experience creating production grade data pipelines in Python.
• Excellent communication skills and ability to collaborate effectively with team.
• Proven track record of mentoring engineers and leading technical work.

Responsibilities

• Contribute to the codebase and participate in peer reviews.
• Design and build distributed data processing platform using Python and related technologies.
• Take ownership of end-to-end deliverables from planning to production.

Skills

Data engineering best practices

Clean & efficient code

Python

Collaboration

Problem solving

Tools

AWS Glue

Spark

Airflow

DynamoDB

S3

Job description

Join the team, an exciting new project aiming to have us enter the Consumer Credit Bureau space in the United Kingdom and eventually become a fully-fledged Consumer Reporting Agency. We’re looking for a Quality Engineer experienced in testing cloud-native software systems.

WHO WE ARE

Privately owned and independently minded, at Creditsafe, we are guided by values of customer-focus, trust, respect, and a willingness to try new things. For over 20 years, these values have shaped a culture of growth, innovation, and support, where our team members build successful, long-term careers.

With a diverse team spread across 25 offices in 14 countries, we value collaboration, learning, and problem-solving together. We have been featured twice in The Sunday Times' '100 Best Companies to Work For' and continue to prioritize well-being, career growth, and inclusion.

Our continued success has made us the most used business data provider in the world and one of the industry’s strongest growing business intelligence providers. Today Creditsafe has 23 offices across 3 continents serving 110,000 customers from SMEs to enterprise businesses.

THE TEAM

Join a team of highly technically skilled engineers who are designing Creditsafe’s new Consumer Bureau with data quality, lineage, and auditability as primary goals whilst maintaining high throughput and scalability. The data platform will be built using AWS infrastructure such as S3 and S3-tables(Iceberg), Aurora Serverless, DynamoDB, Lambda, Fargate, ECS, Airflow, Spark and Kinesis. The platform is expected to manage over one hundred million objects with a high volume of daily updates handling addition, deletion, and correction of our data and indexes in an auditable manner. The platform will employ a sophisticated matching algorithm to enable us to assign incoming updates to existing objects. Our data processing application is entirely based on Python and designed to efficiently transform incoming raw data volume into API consumable schema. The team is also building highly available and low latency APIs to enable our clients with faster data delivery.

WHAT YOU'LL OWN

Contributing actively to the codebase and participating in peer reviews. This is not a passive "take a ticket and close it" role -- you will drive development from 3-Amigo's refinement sessions all the way to post-deployment observability.

Design and build metadata driven, event based distributed data processing platform using technologies such as Python, Spark, Airflow, Iceberg, DynamoDB, AWS Glue, S3.

Play an active role in the design, development, and deployment of our business-critical system.

Building and scaling Creditsafe’s data pipelines combining batch and streaming approaches and targeting sub-500ms latency serving.

Understanding domain data to make recommendations to improve the existing product.

Employing various AI tools such as Perplexity, Cursor, CoPilot, etc to aid in all aspects of your work.

WHAT YOU NEED TO BRING

You understand and can implement data engineering best practices.

You demonstrate the ability to write clean & efficient code and combine it with the cloud environment for best performance.

You have a minimum 6 years of development experience within a commercial environment creating production grade data pipelines in python.

You are looking to grow your skills through daily technical challenges and enjoy problem solving, whiteboarding in collaboration with team.

You have excellent communication skills, and ability to explain your views clearly to the team and are open to understanding the views of others.

You have a proven track record to draw from a deep and broad technical expertise to mentor engineers, complete hands-on technical work, and provide leadership on complex technology issues.

You share your ideas collaboratively via wikis, discussions boards, etc and share any decisions made, for the benefit of others.

You take ownership of end-to-end deliverables from planning all the way to production.

WHY CREDITSAFE

• IC ladder with teeth. Staff and Principal are a destination, not a waypoint - with scope, comp and influence that genuinely match the title.
• Written design culture. Anything non-trivial gets an RFC. Decisions are recorded. We disagree in documents, not in meetings.
• Real operability. We run what we build. No hand-offs to a separate ops team.
• Pragmatic agile. Teams own their own process. We optimise for shipping, not ceremony.
• Customer-first. Our focus is on making work that adds value to our clients first. Stability, freshness, durability, trust – non-negotiable.
• Leadership you’ll want to work with. Engineering leadership is technical, present, and will back your calls.
• Company Laptop.
• Bonus Scheme.
• E-learning and career development opportunities.
• Global company gatherings and events.
• Plus more that can be found on the benefits section on the Careers page, https://careers.creditsafe.com/gb
• We are committed to providing a welcoming, supportive environment. Creditsafe is an equal opportunities employer that values diversity. Please contact us if you need any assistance with your application. https://creditsafecareers.kinsta.cloud/gb/