Lead Data Engineer

Coforge; Dubai; On-site; AED 350,000 - 600,000; Full time

Job summary

Coforge in Dubai, UAE is seeking a Lead Data Engineer to design and build scalable data pipelines, data lake/warehouse, and BI solutions to support business analytics. You will convert business requirements into robust data architectures, ensure data quality and governance, and collaborate with cross-functional teams on best practices.

Strong hands-on experience with cloud data platforms and big data tooling is essential.

Qualifications

• Strong hands-on experience in end-to-end Data Engineering.
• Experience building Data Lake, Data Warehouse and BI solutions.
• Exposure to Agile/Waterfall methodologies.
• Excellent problem-solving and stakeholder management skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT solutions.
• Build Data Lake, Data Warehouse, BI, and Analytics platforms.
• Convert business requirements into robust technical solutions.
• Ensure data quality, security, governance, and performance optimization.
• Perform code reviews, troubleshooting, and production support.
• Collaborate with cross-functional teams on architecture and data engineering best practices.
• Maintain metadata, data lineage, and data governance standards.

Tools

Azure

Cloudera

Hadoop

Spark

Scala

Hive

HBase

Kafka

Azure Data Factory

Databricks

Airflow

Apache NiFi

Oozie

Sqoop

HDFS

ADLS Gen2

Snowflake

Spark Streaming

SnapLogic

TIBCO

SQL

Power BI

MicroStrategy

Elasticsearch

Git

Bitbucket

Azure DevOps

AVRO

PARQUET

Job description

We at Coforge are looking for "Lead Data Engineer" for Dubai, UAE Location:

Detailed Job Description

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT solutions.


• Build Data Lake, Data Warehouse, BI, and Analytics platforms.


• Convert business requirements into robust technical solutions.


• Ensure data quality, security, governance, and performance optimization.


• Perform code reviews, troubleshooting, and production support.


• Collaborate with cross-functional teams on architecture and data engineering best practices.


• Maintain metadata, data lineage, and data governance standards.

Technical Skills

• Cloud & Big Data: Azure, Cloudera, Hadoop, Spark, Scala, Hive, HBase, Kafka


• Data Engineering: Azure Data Factory (ADF), Databricks, Airflow, Apache NiFi, Oozie, Sqoop


• Storage & Processing: HDFS, ADLS Gen2, Snowflake, Streaming (Spark Streaming)


• Data Integration: SnapLogic, TIBCO


• Databases & BI: SQL, Power BI, MicroStrategy, Elasticsearch


• Version Control & DevOps: Git, Bitbucket, Azure DevOps


• File Formats: AVRO, PARQUET

Desired Profile

• Strong hands-on experience in end-to-end Data Engineering.


• Familiarity with Data Lake, Data Warehouse, BI, and Analytics solutions.


• Exposure to Agile/Waterfall methodologies.


• Excellent problem-solving, communication, and stakeholder management skills.


• Team player with a strong learning mindset.