Senior Data Engineer & Platform Architect (Hybrid, Cloud)

bp; Kuala Lumpur; Hybrid; MYR 240,000 - 360,000; Full time

Benefits offered by this job

Generous salary package with annual/aw

15% EPF contributions

Work-life balance & flexible working

Collaborative environment with diverse

Career development & progression

16 weeks parental leave

Job summary

bp in Kuala Lumpur invites seasoned data engineering leaders to shape our cloud-native data platforms. You will architect end-to-end data solutions, oversee ingestion, storage, and orchestration, and guide teams across data science and software engineering.

The role requires 8+ years in data/software engineering, strong Python and PySpark skills, AWS expertise, and a proven track record in enterprise-scale deployments.

Qualifications

• 8+ years of experience in Data/Software Engineering or related fields.
• 5+ years with Python for data engineering and automation.
• 3+ years with PySpark and distributed processing at scale.
• Strong database design, SQL & relational modelling skills.
• Experience building enterprise-scale data pipelines and platforms.
• Cloud-native data solutions on AWS (S3, Glue, EMR, Lambda, Redshift).

Responsibilities

• Lead data engineering initiatives and drive architectural decisions.
• Mentor engineers and foster high-performing teams.
• Oversee CI/CD pipelines, Git workflows, and release management.
• Ensure data governance, security, and compliance.
• Collaborate across teams to deliver scalable data platforms.
• Evaluate new data technologies and drive continuous improvement.

Skills

Data Engineering

Architecture Design

Mentoring

Cross-functional Leadership

Cloud Architecture

Security & Governance

Communication

Tools

Python

PySpark

Databricks

SQL

AWS

S3

Glue

EMR

Redshift

Airflow

Git

CI/CD

Terraform

Job description

bp in Kuala Lumpur invites seasoned data engineering leaders to shape our cloud-native data platforms. You will architect end-to-end data solutions, oversee ingestion, storage, and orchestration, and guide teams across data science and software engineering.

The role requires 8+ years in data/software engineering, strong Python and PySpark skills, AWS expertise, and a proven track record in enterprise-scale deployments.