Azure Data Engineer

PCS Gulf excels in IT and financial consulting, driven by the belief that optimal solutions arise from a diverse network of experts collaborating across IT, Finance, and business strategy. Our seasoned team remains industry leaders, staying updated on the latest trends. We provide innovative, cutting-edge solutions tailored to clients' needs, drawing from vast industry exposure. Collaborating closely, we craft comprehensive solutions addressing all aspects of business. With a stellar track record and proficiency, we empower clients, from startups to large corporations, to realize their full potential. At PCS Gulf, our unwavering dedication is to deliver tangible results.

Responsibilities:

• You are detailed reviewing and analysing structured, semi-structured and unstructured data sources for quality, completeness, and business value.
• You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
• You participate in early state design and feature definition activities.
• Responsible for implementing robust data pipeline using Microsoft, Databricks Stack.
• Responsible for creating reusable and scalable data pipelines.
• You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.

Requirements:

• Advanced working knowledge and experience with relational and non-relational databases.
• Experience building and optimizing Big Data data pipelines, architectures, and data sets.
• Strong experience in Azure Datafactory, Databricks, Eventhub, Python, PySpark, Azure Synapse and SQL.
• Azure Devops experience to deploy the ADF pipelines.
• Minimum 3-5 years of experience.
• Knowledge/Experience with Azure cloud stack.