Lead Cloud Data Engineer

Marc Ellis; United Arab Emirates; On-site; USD 50,000 - 90,000; Full time

Job summary

A leading company in the UAE is looking for a Lead Cloud Data Engineer to develop and manage data engineering workloads on Azure. This 6-month extendable role requires strong expertise in Azure Data Factory and Databricks, along with significant experience in cloud data engineering. Candidates are encouraged to apply with their CV for this exciting opportunity.

Qualifications

• 5-7 years of experience in data engineering and transformation on Cloud.
• 3+ Years of strong experience in Azure Data Engineering.
• Expertise in implementing Data warehouse workloads at an enterprise level.

Responsibilities

• Develop and deploy data engineering workloads in Databricks on Azure.
• Collaborate with business lines to understand data ingestion requirements.
• Translate requirements into cloud data engineering workload designs.

Skills

Data Engineering

Azure Data Engineering

Databricks

Pyspark

Agile Methodology

Education

Bachelor’s degree in Computer Science/Information Technology or Engineering

Tools

Azure Data Factory

Job description

Job Title:Lead Cloud Data Engineer

Duration: 06 months extendable (Long Term with Marc Ellis Payroll)

Location:Dubai, UAE

Key Responsibilities:

• Developing and deploying data engineering workloads in Databricks on the Azure cloud infrastructure, managing and monitoring performance of these workloads, and ensuring security, availability, and scalability of cloud resources.
• Work with the business lines to understand the data ingestion and cloud data engineering requirements
• Work with the data modellers to translate the same into cloud/on-prem data engineering workloads design and then develop the same into appropriate engineering language – Databricks pipelines and ADF pipelines.
• Very strong hands-on skills and at least 3 years’ experience in developing databricks and Azure Data Factory pipelines
• Follow the principle of medallion architecture (3 layers of data in Azure data lake) of getting the data in right data zones basis the requirement
• Work and collaborate in multi-disciplinary Agile teams, adopting Agile spirit, methodology and tools

Requirements:

• Overall, 5-7 years of experience in data engineering and transformation on Cloud
• 3+ Years of Very Strong Experience in Azure Data Engineering, Databricks
• Expertise in supporting/developing Data warehouse workloads at enterprise level
• Experience in Pyspark is required – developing and deploying the workloads to run on the Spark distributed computing
• Candidate must possess at least a Graduate or Bachelor’s degree in Computer Science/Information Technology, Engineering (Computer/Telecommunication) or equivalent.
• Cloud deployment: Preferably Microsoft azure
• Experience in implementing the platform and application monitoring using Cloud native tools

Interested candidates can send your CV to: [e-mail]

#jobs #hiring #jobsindubai #dubaijobs #dubaicareers #uaejobs #uae #uaecareers #ksacareer #ksajobs #saudijobs #saudihiring #ksa #saudiarabiajobs #riyadhjobs #qatarjobs #dohajobs #qatar #ksajobs #riyadhjobs #dubaijobs #uaejobs