Data Engineer

JR United Kingdom; Cardiff; Hybrid; GBP 40,000 - 80,000; Full time

Job summary

An established industry player is seeking a Data Engineer to join their dynamic team in Cardiff. This role offers the chance to work with cutting-edge technologies, including AWS, while developing data pipelines that facilitate informed decision-making. You'll collaborate closely with product teams and data analysts in a hybrid work environment, ensuring the delivery of high-quality data processing systems. If you're passionate about data engineering and eager to contribute to a culture of innovation and growth, this opportunity is perfect for you.

Benefits

Company Laptop supplied

Bonus Scheme

Cycle to work

Wellbeing Programme

Global Company gatherings

E-learning opportunities

Career progression opportunities

Qualifications

• Experience with designing and building autonomous fault-tolerant data pipelines.
• Solid experience creating production-grade ETL and ELT pipelines in Python.

Responsibilities

• Develop, test, and maintain high-quality data processing systems.
• Extract data from various sources like databases, files, and APIs.
• Design and build metadata-driven data pipelines using Python and SQL.

Skills

Python

SQL

ETL/ELT Pipelines

AWS

Agile Methodologies

Data Orchestrators (Airflow)

Relational Databases (Oracle, PostgreSQL, MySQL)

Infrastructure as Code (Terraform, Ansible)

Data Quality Testing

Job description

Social network you want to login/join with:

We are currently looking a Data Engineer, to join the Data Engineering team in Cardiff.

You will be expected to attend the office 50% of the working week, to align with our hybrid working policy.

WHO ARE WE?

At Creditsafe, we weave our core values of customer-obsession, trust, respect and the courage to be different into the very fabric of our culture. With these values, we’ve fostered a culture of growth, innovation, well-being and success for the last 20 years at Creditsafe and created a legacy of successful career trajectories within our community of Creditsafers.

Powering business decisions for over 100,000 business across the world requires more than just the right tools. As a company, we don’t shy away from rolling up our sleeves to do everything possible to create a welcoming environment where every new talent is guided, supported and nurtured to grow and become a part of the culture.

With 25 offices across 14 countries, our geographically disperse community of colleagues are a testament to our inclusive and diverse culture that comes together to solve complex problems and learn from each other.

Twice featured in The Sunday Times list of ‘100 Best Companies to Work,’ our list of successful Creditsafers who’ve created long-standing, strong career trajectories out of what started out as jobs, just keeps growing. We’re proud to be a part of a culture and a company where careers are made and where talent meet its true potential.

JOB PROFILE

You will be working closely with the product, data analysts and data engineering, building specific systems facilitating the extraction and transformation of Creditsafe data. The role will define and build data pipelines that will enable faster, better, data-informed decision-making both within the business and for Creditsafe customers. This is an opportunity to gain exposure to distributed data architectures with AWS

KEY DUTIES AND RESPONSIBILITIES

• Perform a role as part of an Agile team to develop, test and maintain high quality data processing systems that fulfil business needs.
• Extracting data from various data sources for example relational databases, files and API’s)
• Help evolve our data platform with a view towards growth and high throughput.
• Execute practices such as continuous integration and test driven development to enable the rapid delivery of working code.
• Design and build metadata driven data pipeline using Python and SQL in accordance with guidelines set by the Data Architect
• Ship medium to large features independently using industry standard processing patterns

The responsibilities detailed above are not exhaustive and you may be requested to take on additional responsibilities deemed as reasonable by their direct line manager.

SKILLS AND QUALIFICATIONS

• Experience designing and building autonomous fault tolerant data pipelines
• Solid development experience within a commercial environment creating production grade ETL and ELT pipelines in python
• Comfortable implementing data architectures in analytical data warehouses such as Snowflake, Redshift or BigQuery
• Hands on experience with data orchestrators such as Airflow
• Knowledge of Agile development methodologies
• Awareness of cloud technology particularly AWS.
• Knowledge of automated delivery processes
• Hands on experience of best engineering practices (handling and logging errors, system monitoring and building human-fault-tolerant applications)
• Ability to write efficient code and comfortable undertaking system optimisation and performance tuning tasks
• Comfortable working with relational databases such as Oracle, PostgreSQL, MySQL
• Has exposure to DBT and data quality test frameworks
• Has awareness of Infrastructure as Code such as Terraform and Ansible

BENEFITS

• Company Laptop supplied.
• Bonus Scheme.
• Cycle to work and Wellbeing Programme.
• Global Company gatherings and events.
• E-learning and excellent career progression opportunities.
• Plus more that can be found on the benefits section on the Careers page, https://careers.creditsafe.com/gb.

Creditsafe is an equal opportunities employer that values diversity. Please contact Creditsafe if there is any support you need with your application.