Azure Data Engineer

PCS Gulf; Dubai; On-site; AED 120,000 - 180,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer to join their dynamic team. In this role, you will leverage your expertise in data analysis and pipeline development to create innovative solutions that drive business success. Collaborating with cross-functional teams, you will design and implement scalable data architectures, ensuring the integrity and value of data across various platforms. This is a fantastic opportunity to work with cutting-edge technologies in a collaborative environment, where your contributions will empower clients to achieve their goals. If you're passionate about data and looking to make a significant impact, this role is for you.

Qualifications

• 3-5 years of experience in data engineering with a focus on cloud technologies.
• Strong knowledge of relational and non-relational databases.

Responsibilities

• Review and analyze various data sources for quality and business value.
• Implement robust data pipelines using Microsoft and Databricks Stack.

Skills

Data Analysis

Data Pipeline Development

Team Collaboration

Problem Solving

Education

Bachelor's Degree in Computer Science or related field

Tools

Azure Datafactory

Databricks

Eventhub

Python

PySpark

Azure Synapse

SQL

Azure DevOps

Job description

PCS Gulf excels in IT and financial consulting, driven by the belief that optimal solutions arise from a diverse network of experts collaborating across IT, Finance, and business strategy. Our seasoned team remains industry leaders, staying updated on the latest trends. We provide innovative, cutting-edge solutions tailored to clients' needs, drawing from vast industry exposure. Collaborating closely, we craft comprehensive solutions addressing all aspects of business. With a stellar track record and proficiency, we empower clients, from startups to large corporations, to realize their full potential. At PCS Gulf, our unwavering dedication is to deliver tangible results.

Responsibilities:

• You are detailed reviewing and analysing structured, semi-structured and unstructured data sources for quality, completeness, and business value.
• You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
• You participate in early state design and feature definition activities.
• Responsible for implementing robust data pipeline using Microsoft, Databricks Stack.
• Responsible for creating reusable and scalable data pipelines.
• You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.

Requirements:

• Advanced working knowledge and experience with relational and non-relational databases.
• Experience building and optimizing Big Data data pipelines, architectures, and data sets.
• Strong experience in Azure Datafactory, Databricks, Eventhub, Python, PySpark, Azure Synapse and SQL.
• Azure Devops experience to deploy the ADF pipelines.
• Minimum 3-5 years of experience.
• Knowledge/Experience with Azure cloud stack.