Senior Data Engineering Lead – Real-Time Pipelines

Mashreqbank PSC

Pakistan

On-site

PKR 3,500,000 - 7,000,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mashreqbank PSC is seeking a Senior Data Engineer to design and maintain scalable data pipelines and architectures across on-prem and cloud data lakes. You will lead a team of data engineers, develop ETL/ELT processes, and ensure data quality and governance for data-driven decision making in banking operations.

The role requires deep expertise in Spark, Python, SQL, Hive, and cloud platforms (Azure/AWS), with strong collaboration across stakeholders in the Bank.

Qualifications

  • 12 – 15 Years of Total Experience in Software Development.
  • 10+ years of experience Big Data, Hadoop, Data Lake, Data Mesh Architectures, Azure Cloud, Microsoft SQL Server, Unix, and platform migrations, Apache Spark, Pyspark, Hive, Azure data bricks, ADF.
  • Should have managed successful execution of minimum 1 large engagement into production go live.
  • Should have good knowledge of Platform management of Cloud, DWH, Azure and Data Lake.
  • Good in Data Management Fundamentals and Data Architect, Modelling, Governance and Data security.
  • Strong in writing & tuning the Data Ingestion jobs, Spark applications, python, Hive, Azure Databricks, Azure Data Factory and Azure SQL.

Responsibilities

  • Data Architecture Design: design and maintain the data architecture with scalable pipelines, data models, and integration strategies.
  • Business focus deliverables: build scalable & robust data visualization platform and BI solutions for Wholesale & Operations, Risk, Compliance & CX Digitalization.
  • Understand clients’ problems and decide how to cater to their needs, business problems.
  • Proficient in requirement gathering, finalizing scope, consensus building across diverse stakeholders, BRD’s, UAT, demos and trainings, tracking Agile Scrum & rituals.
  • Team Leadership and Management: lead a team of data engineers, manage KRAs, mentor junior engineers, foster collaboration.
  • Data Pipeline Development: develop and optimize ETL/ELT, ingestion, and transformation workflows.
  • Data Quality and Governance: ensure data quality, lineage, security, governance policies, monitoring, and error handling.
  • Performance Optimization: tune queries, optimize storage, leverage distributed computing technologies.
  • Technology Selection and Integration: evaluate and integrate new tools and frameworks to enhance processes.
  • Monitoring and Troubleshooting: set up monitoring and procedures for quick resolution.

Skills

Python
SQL
Spark
Hive
Azure Databricks
Azure Data Factory
Kafka
Java
C#
Unix
Big Data
Data Modeling

Education

Computer Science degree or equivalent

Tools

Sqoop
ADLS
ADF
Azure SQL

Job description

Mashreqbank PSC is seeking a Senior Data Engineer to design and maintain scalable data pipelines and architectures across on-prem and cloud data lakes. You will lead a team of data engineers, develop ETL/ELT processes, and ensure data quality and governance for data-driven decision making in banking operations.

The role requires deep expertise in Spark, Python, SQL, Hive, and cloud platforms (Azure/AWS), with strong collaboration across stakeholders in the Bank.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineering Lead: Real-Time & Cloud Architect
Senior Data Engineering Lead: Real-Time & Cloud Architect

Mashreq Bank PSC • Pakistan

On-site
PKR 1,200,000 - 2,000,000
Senior Data Engineer & Architect — Real-Time Pipelines
Senior Data Engineer & Architect — Real-Time Pipelines

Mashreq • Karachi Division

On-site
PKR 892,800 - 1,339,200
Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE
Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE

Mashreqbank PSC • Pakistan

On-site
PKR 3,500,000 - 7,000,000
Senior Data Platform & Architecture Lead
Senior Data Platform & Architecture Lead

Techsurge Private Limited • Karachi Division

On-site
PKR 3,000,000 - 6,000,000
Principal Data Engineer: Scale Real-Time Data Pipelines
Principal Data Engineer: Scale Real-Time Data Pipelines

Pakistan Single Window • Pakistan

On-site
PKR 2,000,000 - 5,000,000
Competitive salary
Fuel Card
Health benefits
+2
Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE
Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE

Mashreq Bank PSC • Pakistan

On-site
PKR 1,200,000 - 2,000,000
Senior Data Engineer: Real-Time Pipelines & Databricks
Senior Data Engineer: Real-Time Pipelines & Databricks

Mastercard Inc. • Hyderabad City Taluka

On-site
PKR 8,876,000 - 17,751,000
Datacenter Operations & Automation Lead
Datacenter Operations & Automation Lead

Mashreq • Karachi Division

On-site
PKR 1,674,000 - 3,125,000
Entry-Level Analytics Data Scientist – Banking
Entry-Level Analytics Data Scientist – Banking

Mashreq • Karachi Division

On-site
PKR 900,000 - 1,800,000
Principal Data Engineer - Scalable Pipelines & Data Lakes
Principal Data Engineer - Scalable Pipelines & Data Lakes

The Briefed • Karachi Division

On-site
PKR 2,600,000 - 5,200,000
Top locations