Senior Data Platform Lead - Scalable Pipelines & DataOps

Bank Islam Malaysia Berhad; Kuala Lumpur; Sur place; MYR 180 000 - 360 000; Plein temps

Résumé du poste

Bank Islam Malaysia Berhad is seeking a senior data engineering leader to build scalable, reliable data platforms and products. The role oversees engineering quality, DataOps, data reliability, technical standards and team capability.

Design and deliver scalable data pipelines, establish standards, apply DataOps, ensure data reliability and design secure, cost-efficient workloads. Lead reviews, mentor engineers and collaborate with architecture, security, risk, analytics and business

Qualifications

• Bachelor's degree in CS/IT/Data Engineering or related field or equivalent experience.
• Minimum 8 years in data engineering/data platform engineering or enterprise data integration with 2 years in a lead role.
• Strong SQL and Python proficiency; production-grade data pipelines experience.
• Hands-on with distributed processing using Spark or PySpark.
• Experience with Airflow and dbt for data orchestration and modeling.
• Working knowledge of Docker and Kubernetes for data workloads.
• Experience with batch and streaming ingestion, CDC, and Kafka or similar tech.
• Experience with relational and non-relational databases, data lakes/lakehouses and analytic platforms.
• Experience designing data platforms on public cloud with cost monitoring.
• Strong DataOps across Git, CI/CD, IaC and release management.

Responsabilités

• Design and deliver scalable, reliable data pipelines, services, products and reusable components.
• Establish engineering standards for coding, testing, deployment, documentation and data modelling.
• Apply DataOps practices including source control, peer review, CI/CD, IaC and controlled releases.
• Ensure data reliability through orchestration, observability, data-quality controls, metadata, lineage and monitoring.
• Design data workloads for security, resilience, performance and efficient resource use.
• Diagnose and resolve complex data, pipeline, platform and performance issues.
• Lead technical reviews, mentor data engineers and strengthen team capability.
• Communicate technical decisions, risks and trade-offs clearly with architecture, security, risk, analytics and business stakeholders.

Connaissances

SQL

Python

Spark/PySpark

Airflow

dbt

Docker

Kubernetes

Kafka

Data lakes/lakehouses

Cloud cost monitoring

Git

CI/CD

IaC

Release management

Formation

Bachelor's Degree in Computer Science, Information Technology, Data Engineering or related discipline

Description du poste

Bank Islam Malaysia Berhad is seeking a senior data engineering leader to build scalable, reliable data platforms and products. The role oversees engineering quality, DataOps, data reliability, technical standards and team capability.

Design and deliver scalable data pipelines, establish standards, apply DataOps, ensure data reliability and design secure, cost-efficient workloads. Lead reviews, mentor engineers and collaborate with architecture, security, risk, analytics and business