Hybrid Senior Data Engineer – AWS, PySpark, DataOps

BP PLC; Kuala Lumpur; Hybrid; MYR 220,000 - 320,000; Full time

Benefits offered by this job

Life and health insurance

Learning opportunities

Career development

Job summary

BP plc in Kuala Lumpur is seeking a Senior Data Engineer for a hybrid office/remote role. You will drive engineering best practices, lead deployment processes, and mentor engineers to build a high-performing data platform team.

The role requires 8+ years in data/software engineering, 5+ years of Python, and 3+ years PySpark with large-scale data processing. Strong AWS, Databricks, and DevOps practice experience are essential.

Qualifications

• 8+ years of experience in Data Engineering, Software Engineering, or related disciplines.
• 5+ years of hands-on Python development experience.
• 3+ years of experience with PySpark and large-scale distributed data processing.
• Experience delivering and operating enterprise-scale data platforms and pipelines.
• Experience with DataOps, DevOps, SRE, or production support environments.

Responsibilities

• Drive engineering best practices through code reviews, technical standards, CI/CD practices, and automation.
• Lead source control, release management, and deployment processes for data engineering solutions.
• Mentor engineers and contribute to building a high-performing engineering culture through knowledge sharing.

Skills

Python

PySpark

AWS

Databricks

SQL

DataOps

DevOps

CI/CD

Git

Tools

Databricks

Terraform

Docker

CI/CD tooling

Job description

BP plc in Kuala Lumpur is seeking a Senior Data Engineer for a hybrid office/remote role. You will drive engineering best practices, lead deployment processes, and mentor engineers to build a high-performing data platform team.

The role requires 8+ years in data/software engineering, 5+ years of Python, and 3+ years PySpark with large-scale data processing. Strong AWS, Databricks, and DevOps practice experience are essential.