Senior Data Engineer | Azure Data Platform & ETL Expert

Dicetek LLC; Dubai; Sur place; AED 240 000 - 360 000; Plein temps

Résumé du poste

Dicetek LLC in Dubai seeks a data engineer to design and implement robust data pipelines from diverse sources to storage, optimizing ingestion and transformation for real-time analytics.

You will collaborate with data scientists to translate requirements into technical specs, and ensure data quality with automated validation and monitoring systems. A 4+ year track record and Azure Data Factory/Databricks expertise are essential.

Qualifications

• Bachelor's degree in Computer Science, IT, Data Engineering or related field.
• 4+ years in Data Engineering, Data Integration and Cloud Data Platforms.
• Strong Azure data platform expertise and SQL development skills.
• Experience with data modeling and data warehousing concepts.
• Proven ability to integrate multiple systems via REST APIs and file protocols.

Responsabilités

• Design and implement robust data pipelines for diverse sources to data storage.
• Optimize data ingestion and transformation for real-time analytics.
• Collaborate with data scientists to translate requirements into technical specs.
• Ensure data quality with automated validation and monitoring systems.

Connaissances

Azure Data Factory

Azure Databricks

Azure Data Lake Storage Gen2

Azure Synapse Analytics

Delta Lake

Python

PySpark

SQL development

REST APIs

SHIR (Self-Hosted Integration Runtime)

Formation

Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field

Outils

Databricks Medallion Architecture

Delta Lake implementation

Storage Accounts

Description du poste

Dicetek LLC in Dubai seeks a data engineer to design and implement robust data pipelines from diverse sources to storage, optimizing ingestion and transformation for real-time analytics.

You will collaborate with data scientists to translate requirements into technical specs, and ensure data quality with automated validation and monitoring systems. A 4+ year track record and Azure Data Factory/Databricks expertise are essential.