AWS Data Engineer

DMG Events; Dubai; On-site; AED 120,000 - 180,000; Full time

Job summary

An innovative company is seeking a skilled AWS Data Engineer to enhance their Customer Data Platform (CDP) project. In this pivotal role, you will design and maintain data lake solutions, ensuring data quality and efficiency throughout the data journey. You will collaborate with a dynamic team, driving the data strategy and coaching junior members to embrace cloud engineering practices. This position offers an exciting opportunity to contribute to a data-driven culture, leveraging cutting-edge AWS technologies. If you are passionate about data and eager to make an impact, this role is perfect for you.

Qualifications

• 5+ years as a Data Engineer with AWS experience.
• Hands-on with S3, Redshift, Glue, Lambda, and API Gateway.

Responsibilities

• Design and maintain the data lake solution and pipelines.
• Develop data strategy and ensure data quality throughout the process.

Skills

Data Engineering

AWS Cloud

Python

Spark

Scala

Data Quality Management

REST APIs

Agile Methodologies

Tools

AWS S3

AWS Redshift

AWS Glue

AWS Lambda

API Gateway

Bitbucket

Jenkins

ServiceNow

Job description

dmg events is an international exhibitions and publishing company. We attract more than 425,000 visitors to our global portfolio of 80 exhibitions each year. Through our global events, our aim is simple. We want to accelerate business through face-to-face events, which is why we work so hard to bring people together, creating opportunities for them to network, learn and do business. dmg events is part of the Daily Mail Group Trust (DMGT). DMGT manages a diverse, multinational portfolio of companies with total revenues of £2bn, that provide businesses and consumers with compelling information, analysis, insight, events, news, and entertainment.

Introduction

We are looking for an experienced AWS Data Engineer to join our team to support the development of the Customer Data Platform (CDP) project. As a Data Engineer, you will work closely with the Lead Engineer, Business Analysts and third-party professional services to lay the groundwork to enable the business to truly become data-driven, creating the one source of truth for our customer data.

Responsibilities

• Designing, building and maintaining the data lake solution and associated pipelines
• Develop and own the data strategy on coding best practices
• Contribute to the overall architecture by identifying gaps and efficiencies in the design
• Ensuring that data quality is considered at every point of the data journey and working closely with the business to ensure the correct rules and identifiers are in place
• Coaching the junior members of the Data team to be more cloud engineering focused
• Maintaining, testing and implementing disaster recovery procedures.

Skills / Qualifications

• 5+ years as a Data Engineer within the AWS cloud environment
• Hands-on experience with the following:
• S3 / Redshift
• AWS Glue
• AWS Lambda
• API Gateway
• Amazon AppFlow (Desirable)
• Expertise in moving and transforming data using Python, Spark & Scala
• Experience in using REST APIs for data transfer
• Solid understanding of master data management and its integration into the broader infrastructure
• Knowledge and experience with testing, releasing, and CI / CD pipeline deployments into AWS using tools like Bitbucket, Jenkins, ServiceNow
• Understanding of Agile methodologies, processes and procedures
• Demonstrated ability to be a self-starter and take ownership of their work
• Experience in using SalesForce would be considered an advantage

Please take the time to read the job description; you must meet all the criteria set out above for your application to be considered. We do check all applications, and suitable candidates will be contacted within 5 days. If you are not contacted by us within 5 working days, please consider your application unsuccessful at this time.