Senior Data Engineer | Azure Data Platform & ETL Expert

Dicetek LLC; Dubai; On-site; AED 240,000 - 360,000; Full time

Job summary

Dicetek LLC in Dubai seeks a data engineer to design and implement robust data pipelines from diverse sources to storage, optimizing ingestion and transformation for real-time analytics.

You will collaborate with data scientists to translate requirements into technical specs, and ensure data quality with automated validation and monitoring systems. A 4+ year track record and Azure Data Factory/Databricks expertise are essential.

Qualifications

• Bachelor's degree in Computer Science, IT, Data Engineering or related field.
• 4+ years in Data Engineering, Data Integration and Cloud Data Platforms.
• Strong Azure data platform expertise and SQL development skills.
• Experience with data modeling and data warehousing concepts.
• Proven ability to integrate multiple systems via REST APIs and file protocols.

Responsibilities

• Design and implement robust data pipelines for diverse sources to data storage.
• Optimize data ingestion and transformation for real-time analytics.
• Collaborate with data scientists to translate requirements into technical specs.
• Ensure data quality with automated validation and monitoring systems.

Skills

Azure Data Factory

Azure Databricks

Azure Data Lake Storage Gen2

Azure Synapse Analytics

Delta Lake

Python

PySpark

SQL development

REST APIs

SHIR (Self-Hosted Integration Runtime)

Education

Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field

Tools

Databricks Medallion Architecture

Delta Lake implementation

Storage Accounts

Job description

Dicetek LLC in Dubai seeks a data engineer to design and implement robust data pipelines from diverse sources to storage, optimizing ingestion and transformation for real-time analytics.

You will collaborate with data scientists to translate requirements into technical specs, and ensure data quality with automated validation and monitoring systems. A 4+ year track record and Azure Data Factory/Databricks expertise are essential.