Senior Data Engineer: AI-Ready Cloud Data Platform

Oman Shell; Singapore; Hybrid; SGD 150,000 - 190,000; Full time

Benefits offered by this job

Flexible working hours

Remote/mobile working

Paid parental leave

Job summary

Shell Energy LNG in Singapore seeks a Senior Data Engineer to design, build, and evolve a scalable data platform that enables advanced analytics, AI solutions, and digital innovation. You will partner with business, architecture, and AI teams to create trusted data foundations that accelerate decision‑making and business value.

Responsibilities include delivering production data solutions using Azure technologies, ensuring data quality and governance, and promoting best practices across teams.

Qualifications

• Significant experience in Data Engineering and Data Integration roles.
• Extensive experience delivering enterprise‑grade data platforms and integration solutions.
• Proven experience delivering enterprise‑grade data platforms and pipelines in cloud environments.
• Expert in Azure, Azure Data Factory (ADF), data pipelines, Azure Data Lake Storage (ADLS), Databricks, PySpark, Python, and Kafka, with working knowledge of databases including Cosmos DB and MongoDB.
• Proficiency in data modelling.
• Expert in Azure, Azure Data Factory, data pipelines, Azure Data Lake Storage, Databricks, PySpark, Python, and Kafka, with working knowledge of databases including Cosmos DB and MongoDB.
• Proficiency in data modelling.
• Experience implementing performance optimization techniques using PySpark and SQL.
• Experience working with source control technologies (e.g., GitHub, Azure DevOps) and with build and release pipelines.
• Hands-on experience delivering digital solutions such as enterprise data platforms, and rolling out and setting up Master Data Management, Data Catalogue, and analytics solutions to support business decision-making.
• Experience working in Agile teams, applying best patterns and practices with an eye for quality and standards.
• Experience with Microsoft Power Platform, specifically Power Automate.
• Good to have: Databricks Certified Associate / Professional Data Engineer.
• Experience with LNG business stakeholders and data products.
• Experience supporting AI, machine learning, or Generative AI solutions in production environments.

Responsibilities

• Design, build, and optimize scalable data pipelines, integrations, and lakehouse solutions that support large and complex datasets.
• Develop and deploy production‑ready data solutions using modern cloud and data engineering technologies.
• Drive performance optimization, automation, and continuous improvement across data platforms.
• Build and support data interfaces across enterprise applications, platforms, and external partners.
• Ensure data quality, lineage, governance, and compliance requirements are embedded within solutions.
• Maintain reliable and secure data flows through proactive monitoring, troubleshooting, and issue resolution.
• Partner with business stakeholders, product owners, architects, and delivery teams to translate business requirements into scalable data solutions.
• Contribute to solution design, estimation, backlog prioritization, and Agile delivery activities.
• Promote engineering best practices, standards, and reusable capabilities across teams.
• Enable AI, advanced analytics, and data‑driven decision‑making by delivering trusted, high‑quality data foundations.
• Collaborate with data scientists and architects to develop scalable, AI‑ready datasets and platform capabilities.
• Identify opportunities to enhance platform scalability, interoperability, automation, and digital innovation across the business.

Skills

Azure Data Factory

Databricks

PySpark

Python

Kafka

Azure Data Lake Storage

Cosmos DB

MongoDB

Data modelling

Power Platform

GitHub

Azure DevOps

Power Automate

Generative AI

Power Platform

Tools

GitHub

Azure DevOps

Cosmos DB

MongoDB

Azure Data Factory

Job description

Shell Energy LNG in Singapore seeks a Senior Data Engineer to design, build, and evolve a scalable data platform that enables advanced analytics, AI solutions, and digital innovation. You will partner with business, architecture, and AI teams to create trusted data foundations that accelerate decision‑making and business value.

Responsibilities include delivering production data solutions using Azure technologies, ensuring data quality and governance, and promoting best practices across teams.