Senior/ Data Engineer

HYPERSCAL SOLUTIONS PTE. LTD.; Singapore; On-site; SGD 100,000 - 130,000; Full time

Job summary

A leading maritime company seeks a Senior Data Engineer to build and govern data pipelines within a cross-functional team. This role involves creating CI/CD pipelines, ensuring data quality, and translating business needs into effective data solutions.

Qualifications

• 5+ years in Data Engineering, deep understanding of principles and best practices.
• Experience with Agile environments, adaptability in fast-paced settings.

Responsibilities

• Build and maintain the modern Lakehouse, focusing on data pipeline development.
• Collaborate with team members to ensure solutions meet business requirements.

Skills

Collaboration and Communication

Analytical Thinking

Data Modeling

CI/CD Pipeline Creation

Infrastructure as Code

Spark

Azure Databricks

Job description

COMPANY DESCRIPTION

As the world's leading owner and operator of LPG carriers with five decades of operating experience, BW LPG promotes competitive, sustainable solutions to secure value for society and our stakeholders.

Our global footprint spans seven countries with 17 nationalities represented across our workforce. Our fleet of 39 Very Large Gas Carriers (VLGC) offer a total carrying capacity of over 3 million CBM. From spot voyages and time charters to Contracts of Affreightments (CoAs), our emphasis on flexible, reliable service has earned the trust of leading oil companies as well as trading and utility companies. More information about BW LPG can be found at www.bwlpg.com.

BW LPG is associated with BW Group, a leading global maritime company involved in shipping, floating infrastructure, deepwater oil & gas production, and new sustainable technologies. Founded in 1955 by Sir YK Pao, BW controls a fleet of over 490 vessels transporting oil, gas and dry commodities, with its 200 LNG and LPG ships constituting the largest gas fleet in the world. In the renewables space, the group has investments in solar, wind, batteries, biofuels and water treatment. BW LPG, as a member of the BW Group, is one of Forbes World's Best Employers 2023.

RESPONSIBILITIES

Role Overview

The Senior Data Engineer has a role focusing on building our modern Lakehouse including owning pipeline development, data modeling and governance within a cross-functional team responsible for the end-to-end delivery of data products and analytics solutions.

Additionally creating CI/CD pipelines for automated deployments and monitoring, and enforce data quality checks, ensuring data consistency, reliability, and compliance.

Key Responsibilities

Working with Product Owners, Business Analysts and Data Analysts to ensure business requirements are translated into data solutions, deliver accurate and reliable datasets that enable impactful analytics and dashboards.

They collaborate with System Analysts and the Business to understand the business logic and data lifecycle within our systems and inform our solution design with a goal of balancing scalability and performance.

QUALIFICATIONS

Skills

• Collaboration and Communication Skills: Excels at working in a team to align data solutions with business needs, focused on creative problem-solving in a fast-paced environment.
• Analytical Thinking & Communication: Strong skills in analyzing and translating data-driven insights and requirements to both technical and non-technical stakeholders.
• Spark & Azure Databricks: Proficiency in designing and implementing data pipelines to support reliable data ingestion and transformation using Databricks and Spark.
• Data Modeling Expertise: Advanced SQL and Python skills for complex queries and data modeling, enabling efficient data access and transformation.
• CI/CD Pipeline Creation: Experience in creating CI/CD pipelines, enabling automated testing, validation, and deployment of data pipelines models using GitHub and GitHub Actions with Databricks.
• Infrastructure as Code: Experience in automating cloud infrastructure management for consistent deployment and scaling using tools like Terraform.

Experiences

• 5+ Years in Data Engineering: Proven experience building and maintaining data infrastructure, with a deep understanding of data engineering principles and best practices.
• Agile Mindset and Experience: Thrives in Agile Environments, with a strong resilience, adaptability and responsiveness to change in fast-paced settings.

OTHER INFORMATION

Only shortlisted candidate will be notified.

Please note that your application will be sent to and reviewed by the direct employer - BW LPG Holding Pte Ltd