Senior Data Engineer

bp; Kuala Lumpur; Hybrid; MYR 180,000 - 240,000; Full time

Benefits offered by this job

Life and health insurance

Hybrid work arrangement

Learning opportunities

Job summary

bp is seeking a Senior Data Engineer to design, develop, and maintain robust data pipelines and infrastructure. You will work collaboratively to ensure the integrity, accessibility, and performance of our data assets, contributing to high-performing data solutions.

You will lead data design, modelling, and pipeline engineering while mentoring teammates and ensuring secure, resilient data platforms. This role is hybrid, based in Kuala Lumpur, Malaysia, with opportunities across our data org.

Qualifications

• Proven experience in data engineering with a strong understanding of database design and relational data modelling.
• Proficiency in scripting languages for data manipulation and automation.
• Demonstrable experience with solution architecture and system design principles.
• Strong understanding of continuous deployment and release methodologies, including configuration management and source control.

Responsibilities

• Design, develop, and optimize scalable and reliable data solutions, including database design and relational data modelling.
• Implement and manage data pipelines using scripting languages, ensuring data quality and integrity.
• Contribute to solution architecture and system design for complex data projects.
• Lead and participate in continuous deployment and release processes, leveraging configuration management and source control tools.
• Collaborate with cross-functional teams to understand data requirements and deliver effective data solutions.
• Facilitate discussions and problem-solving sessions related to data engineering challenges.

Skills

Data engineering

SQL

Python

ETL

Cloud platforms

NoSQL data modelling

Tools

Airflow

Git

Job description

Let me tell you about the role

Senior Data Engineer to design, develop, and maintain robust data pipelines and infrastructure. This role involves working collaboratively to ensure the integrity, accessibility, and performance of our data assets, contributing to high-performing data solutions.

Entity

Technology

Job Family Group

IT&S Group

Job Description

Senior Data Engineer to design, develop, and maintain robust data pipelines and infrastructure. This role involves working collaboratively to ensure the integrity, accessibility, and performance of our data assets, contributing to high-performing data solutions.

Key Responsibilities

• Design, develop, and optimize scalable and reliable data solutions, including database design and relational data modelling.
• Implement and manage data pipelines using scripting languages, ensuring data quality and integrity.
• Contribute to solution architecture and system design for complex data projects.
• Lead and participate in continuous deployment and release processes, leveraging configuration management and source control tools.
• Collaborate with cross-functional teams to understand data requirements and deliver effective data solutions.
• Facilitate discussions and problem-solving sessions related to data engineering challenges.
• Ensure adherence to information security best practices throughout the data lifecycle.
• Support service operations and resilience of data platforms, troubleshooting and resolving issues promptly.
• Mentor and guide junior team members, contributing to creating a high-performing team.
• Participate in digital project management activities, ensuring timely and successful delivery of data initiatives.

What you will need to be successful (experience and qualifications)

• Proven experience in data engineering with a strong understanding of database design and relational data modelling.
• Proficiency in scripting languages for data manipulation and automation.
• Demonstrable experience with solution architecture and system design principles.
• Strong understanding of continuous deployment and release methodologies, including configuration management and source control.
• Experience with information security best practices in a data environment.
• Solid understanding of service operations and resilience within data platforms.
• Excellent collaboration, communication, and facilitation skills.
• Experience in leading or mentoring team members, fostering a high-performing team environment.
• Familiarity with digital project management concepts.

About Bp

At bp, we provide the following environment and benefits to you:

• A company culture where we respect our diverse and unified teams, where we are proud of our achievements and where fun and the attitude of giving back to our environment are highly valued.
• Possibility to join our social communities and networks
• Learning opportunities and other development opportunities to craft your career path
• Life and health insurance, medical care package

And many other benefits. We are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform crucial job functions, and receive other benefits and privileges of employment.

Travel Requirement

No travel is expected with this role

Relocation Assistance

This role is not eligible for relocation

Remote Type

This position is a hybrid of office/remote working

Skills

Cloud Platforms, Cloud Platforms, Collaboration, Communication, Configuration management and release, Continuous deployment and release, Creating a high performing team, Database Design, Digital Project Management, Documentation and knowledge sharing, Emerging technology monitoring, Facilitation, Information Security, Mentoring, Metrics definition and instrumentation, NoSql data modelling, Problem Solving, Relational Data Modeling, Risk Management, Scripting, Secure development, Service operations and resiliency, Software Design and Development, Solution Architecture, Source control and code management {+ 5 more}

Legal Disclaimer

We are an equal opportunity employer. We do not discriminate on the basis of protected characteristics like race, religion, color, sex, national origin, sexual orientation, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.

If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.