Lead Data Platform Engineer – Cloudera, Kafka & Azure

Systems Limited; Punjab; On-site; PKR 3,000,000 - 5,500,000; Full time

Job summary

Systems Limited in Pakistan seeks a Lead Data Engineer to own and advance enterprise data platforms, including Cloudera Data Platform, Azure Data Lake, and Kafka, and to guide architecture, delivery, and operations across on-prem and cloud.

You will mentor a data engineering team, collaborate with security, BI, and analytics groups, drive performance optimization, and ensure compliance and reliability for regulatory reporting.

Qualifications

• 8–15 years of total experience in software development, data engineering, and platform support.
• 6+ years of experience in Big Data, Hadoop, Data Lake/Data Mesh architectures, Azure Cloud, SQL Server, Unix, and platform migrations.
• 3+ years of hands-on experience administering Cloudera/Hortonworks Data Platform.
• 2+ years of experience managing and administering Kafka clusters.
• Strong hands-on experience with Spark, Hive, Sqoop, ADLS, Azure Databricks, and Azure Data Factory.

Responsibilities

• Manage and administer enterprise data platforms including Cloudera, Azure Data Lake, and Kafka across environments.
• Monitor platform health, establish monitoring, and lead troubleshooting of data platform issues.
• Design scalable data architectures, pipelines, data models, and integration solutions.
• Develop and optimize ETL/ELT, data ingestion, transformation, and processing workflows.
• Collaborate with Security, BI, and Analytics teams to ensure availability and compliance.

Skills

Python

SQL

Java

Communication

Problem-solving

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, or equivalent

Tools

Cloudera Data Platform

Azure Data Lake

Kafka

Spark

Hive

Sqoop

Azure Databricks

Azure Data Factory

Azure SQL

Job description

Systems Limited in Pakistan seeks a Lead Data Engineer to own and advance enterprise data platforms, including Cloudera Data Platform, Azure Data Lake, and Kafka, and to guide architecture, delivery, and operations across on-prem and cloud.

You will mentor a data engineering team, collaborate with security, BI, and analytics groups, drive performance optimization, and ensure compliance and reliability for regulatory reporting.