Data Engineer

Marc Ellis; United Arab Emirates; On-site; USD 80,000 - 110,000; Full time

Job summary

An innovative company is seeking a skilled Data Engineer to join their dynamic team in Dubai. In this role, you will leverage your expertise in Azure and Databricks to design and develop robust data engineering solutions. You will work collaboratively within Agile teams, implementing cutting-edge technologies and practices to enhance data ingestion and transformation processes. This position offers a unique opportunity to contribute to multi-cloud environments, ensuring seamless integration with on-premise systems. If you are passionate about data and eager to drive impactful change, this role is perfect for you.

Qualifications

• 5-7 years of experience in data engineering and transformation on Cloud.
• 3+ years of strong hands-on experience in Azure Data Engineering and Databricks.

Responsibilities

• Collaborate with business lines to understand data ingestion and engineering requirements.
• Develop Databricks and Azure Data Factory pipelines.

Skills

Azure Data Engineering

Databricks

PySpark

Data Lake

Agile Methodology

Education

Bachelor's degree in Computer Science

Bachelor's degree in Information Technology

Bachelor's degree in Engineering

Tools

Azure Data Factory

Cloud-native monitoring tools

Job description

Title: Data Engineer

Location: Dubai, UAE

Duration: 6 months extendable

Key Responsibilities:

• Collaborate with business lines to understand data ingestion and engineering requirements.

• Translate requirements into cloud/on-premise data engineering designs and develop Databricks and Azure
Data Factory (ADF) pipelines.

• Strong hands-on skills with at least 3 years of experience in developing Databricks and ADF pipelines.

• Implement medallion architecture principles (three-layered data zones) in Azure Data Lake.

• Work collaboratively within multi-disciplinary Agile teams, adopting Agile methodology and tools.

• Scale and code applications across multi-cloud environments integrated with on-premise systems.

• Proactively identify and remediate potential operational risks in collaboration with the platform lead.

Qualifications & Experience:

Minimum Qualification:

• Bachelor's degree in Computer Science, Information Technology, Engineering
(Computer/Telecommunication), or equivalent.

• Experience:

• 5–7 years of experience in data engineering and transformation on Cloud.

• 3+ years of strong hands-on experience in Azure Data Engineering, Databricks.

• Expertise in supporting and developing enterprise-level data warehouse workloads.

• Proficiency in developing and deploying workloads using PySpark on distributed computing environments.

• Experience with cloud deployment, preferably on Microsoft Azure.

• Experience in platform and application monitoring using cloud-native tools.

• Ability to implement proactive and reactive self-healing solutions for applications.