Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE

Mashreqbank PSC

Pakistan

On-site

PKR 3,500,000 - 7,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mashreqbank PSC is seeking a Senior Data Engineer to design and maintain scalable data pipelines and architectures across on-prem and cloud data lakes. You will lead a team of data engineers, develop ETL/ELT processes, and ensure data quality and governance for data-driven decision making in banking operations.

The role requires deep expertise in Spark, Python, SQL, Hive, and cloud platforms (Azure/AWS), with strong collaboration across stakeholders in the Bank.

Qualifications

  • 12 – 15 Years of Total Experience in Software Development.
  • 10+ years of experience Big Data, Hadoop, Data Lake, Data Mesh Architectures, Azure Cloud, Microsoft SQL Server, Unix, and platform migrations, Apache Spark, Pyspark, Hive, Azure data bricks, ADF.
  • Should have managed successful execution of minimum 1 large engagement into production go live.
  • Should have good knowledge of Platform management of Cloud, DWH, Azure and Data Lake.
  • Good in Data Management Fundamentals and Data Architect, Modelling, Governance and Data security.
  • Strong in writing & tuning the Data Ingestion jobs, Spark applications, python, Hive, Azure Databricks, Azure Data Factory and Azure SQL.

Responsibilities

  • Data Architecture Design: design and maintain the data architecture with scalable pipelines, data models, and integration strategies.
  • Business focus deliverables: build scalable & robust data visualization platform and BI solutions for Wholesale & Operations, Risk, Compliance & CX Digitalization.
  • Understand clients’ problems and decide how to cater to their needs, business problems.
  • Proficient in requirement gathering, finalizing scope, consensus building across diverse stakeholders, BRD’s, UAT, demos and trainings, tracking Agile Scrum & rituals.
  • Team Leadership and Management: lead a team of data engineers, manage KRAs, mentor junior engineers, foster collaboration.
  • Data Pipeline Development: develop and optimize ETL/ELT, ingestion, and transformation workflows.
  • Data Quality and Governance: ensure data quality, lineage, security, governance policies, monitoring, and error handling.
  • Performance Optimization: tune queries, optimize storage, leverage distributed computing technologies.
  • Technology Selection and Integration: evaluate and integrate new tools and frameworks to enhance processes.
  • Monitoring and Troubleshooting: set up monitoring and procedures for quick resolution.

Skills

Python
SQL
Spark
Hive
Azure Databricks
Azure Data Factory
Kafka
Java
C#
Unix
Big Data
Data Modeling

Education

Computer Science degree or equivalent

Tools

Sqoop
ADLS
ADF
Azure SQL

Job description

Data & Analytics Driven Organization: One Data Analytics & AI Business Unit drive the vision to transform the Bank into a Data Driven Organization (DDO) using latest tools and technologies in Data space. Wholesale & Ops Data team is a stream within One Data Organization driving this agenda for Wholesale & Ops Banking function.

  • Data Engineer will design and maintain data pipelines of real-time and batch, creates data strategy, data architecture, best practices and who can lead the organization in making strategical improvements in the data engineering solutions.
  • This role requires to have a knowledge of core system, payment systems, digital journeys, marketing systems, risk and compliance systems which are very data intensive systems across UAE, Egypt, Pakistan and other IBG regions etc.
  • Our core function spans multiple platforms like Enterprise Data Lake, Azure Data Lake, Business Intelligence, Advanced Analytics and Realtime Streaming platforms.
  • The work involves developing new requirements in both on-premises and cloud data lake’s estimating the efforts, designing an effective solution, data architecture and management, change release management, resource management, handling the deliverables across the business groups in the Bank. Also, handling critical applications that influence bank’s management decision making process, regulatory reporting (which can influence financial/non-financial penalties) and operational reporting.
Responsibilities
  • Data Architecture Design: As a Senior Data Engineer, one of the primary responsibilities is to design and maintain the data architecture. This involves creating scalable, efficient, and robust data pipelines, data models, and data integration strategies.
  • Business focus deliverables:
  • Managed to build scalable & robust data visualization platform supported as per organization strategical tools & technology.
  • Develops and maintains scalable Business Intelligence Solutions for Wholesales & Operations, Risk, Compliance & Client Experience (CX) Digitalization
  • Understand clients’ problems and decide how to cater to their needs, business problems.
  • Proficient in requirement gathering, finalizing scope, consensus building across diverse stakeholders, formulating BRD’s, concluding UAT, demos and trainings, tracking Agile Scrum & rituals.
  • Team Leadership and Management: Leading a team of data engineers is a crucial aspect of this role. KRAs include managing team members (both FTE’s and EC’s), assigning tasks, mentoring junior engineers, and fostering a collaborative and productive work environment.
  • Data Pipeline Development: Developing and optimizing data pipelines is essential to ensure smooth data flow from various sources to the data warehouse or data lake. This KRA involves implementing ETL/ELT processes, data ingestion, and transformation workflows.
  • Data Quality and Governance: Ensuring the quality, integrity, lineage, and security of data is another vital aspect of a Lead Data Engineer's role. This involves implementing data governance policies, data monitoring mechanisms, and error handling procedures.
  • Performance Optimization: Responsible for optimizing data processing and query performance. This may involve tuning database queries, optimizing data storage, and leveraging distributed computing technologies.
  • Technology Selection and Integration: Keeping up with the latest trends and advancements in data engineering technologies is crucial. Evaluating and integrating new tools and frameworks to enhance the data engineering processes can be a significant KRA.
  • Monitoring and Troubleshooting: Monitoring new and existing data pipelines to identify and resolve issues is an essential responsibility. This KRA involves setting up monitoring systems and establishing procedures for quick troubleshooting and problem resolution.
Scalability and Resilience

Ensuring that the data engineering infrastructure can scale with increasing data volume and handle failures gracefully is critical. This KRA involves designing for high availability and fault tolerance.

Qualifications
  • 12 – 15 Years of Total Experience in Software Development.
  • 10+ years of experience Big Data, Hadoop, Data Lake, Data Mesh Architectures, Azure Cloud, Microsoft SQL Server, Unix, and platform migrations, Apache Spark, Pyspark, Hive, Azure data bricks, ADF.
  • Should have managed successful execution of minimum 1large engagement into production go live.
  • Should have good knowledge of Platform management of Cloud, DWH, Azure and Data Lake.
  • Good in Data Management Fundamentals and Data Architect, Modelling, Governance and Data security.
  • Strong in writing & tuning the Data Ingestion jobs, Spark applications, python, Hive, Azure Databricks, Azure Data Factory and Azure SQL.
  • Proficient in SQL, python, C#, Java, or another JVM-based language.
  • Proficient in Spark, Hive, Sqoop, ADLS, ADB, ADF and Kafka.
  • Public/Private cloud experience in AWS and/or Azure.
  • Good knowledge of RDBMS and NoSQL database design and best practices.
  • Experience in DWH to Data Lake offloading.
  • Proficient in Data Modeling and Data Governance concepts.
  • Good Domain Knowledge in Banking/Finance area.
Management Skills:
  • Experience in team management, vendor management and project management
  • Handling of Client/Business Escalations
  • Motivated and self-driven to overcome obstacles, complete projects and reach targets.
  • Responsible for overseeing the work of team and motivating team towards a common goal.
  • Experience in conducting activities like budgeting and resource planning.
Additional Skills Desired:
  • Good Communication Skills
  • Strong Analytical Thinking
  • Ability to handle stakeholders.
  • Confident in decision making and the ability to explain processes or choices as needed.
  • Ability to multitask on multiple projects in various phases.
  • Project Methodology Knowledge
  • Program Management & Deliverable
  • Computer Science degree or equivalent
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE
Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE

Mashreq Bank PSC • Pakistan

On-site
PKR 1,200,000 - 2,000,000
Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE
Senior Manager - Data Engineer.MGN Pak - Digital Data Platforms.MIT - PAKCOE

Mashreq • Karachi Division

On-site
PKR 892,800 - 1,339,200
Senior Manager Data
Senior Manager Data

Techsurge Private Limited • Karachi Division

On-site
PKR 3,000,000 - 6,000,000
Senior Data Engineer
Senior Data Engineer

Agentic Global • Lahore

Hybrid
PKR 3,000,000 - 6,000,000
AVP - Finance Technology.MGN Pak - Corporate Affairs Finance Tech.MIT - PAKCOE
AVP - Finance Technology.MGN Pak - Corporate Affairs Finance Tech.MIT - PAKCOE

Mashreqbank PSC • Pakistan

On-site
PKR 67,822,000 - 113,037,000
Data Engineer - Islamabad
Data Engineer - Islamabad

Yeah! Global • Islamabad

On-site
PKR 1,116,000 - 1,674,000
SVP - Enterprise Data, Business Intelligence & Analytics
SVP - Enterprise Data, Business Intelligence & Analytics

Pakistan Single Window • Pakistan

On-site
PKR 8,000,000 - 11,000,000
Competitive salary
Fuel Card
Health benefits
+2
Senior Data Modeler
Senior Data Modeler

Digifloat • Islamabad

On-site
PKR 250,000 - 420,000
Sales Manager (Data Solutions)
Sales Manager (Data Solutions)

Datamatics Technologies • Punjab

On-site
PKR 2,400,000 - 6,000,000
Sales Manager Data Solutions
Sales Manager Data Solutions

Datamatics Technologies • Pakistan

On-site
PKR 2,000,000 - 5,500,000
Top locations