Senior Cloud Data Engineer — Real-Time Pipelines & Lakehouse

OCBC Group; Singapore; On-site; SGD 90,000 - 150,000; Full time

Benefits offered by this job

Competitive base salary

Holistic benefits

Community initiatives

Learning & development opportunities

Job summary

OCBC Group is seeking a Senior Data Engineer to design scalable data pipelines on a cloud platform, leveraging Spark, PySpark, and Iceberg. You will modernize data processing using cloud-native approaches and contribute to data governance with open catalogues.

The role emphasizes real-time streaming, SQL migration, and end-to-end ETL/ELT development with Python. Collaboration with analysts and data scientists is essential in delivering robust data solutions.

Qualifications

• Minimum 3 years of relevant industry experience.
• Hands-on in cloud-native data engineering and data pipelines.
• Experience with Spark/PySpark and data governance concepts.

Responsibilities

• Design and build scalable data pipelines using cloud-native services.
• Develop real-time streaming pipelines and structured streaming logic.
• Migration of SQL workloads to cloud-native architectures.
• Create end-to-end ETL/ELT workflows with Python and shell scripting.
• Implement data governance with open catalogue frameworks.

Skills

Cloud-native

Spark

Python

Iceberg

SQL

Education

Bachelor's in Computer Science/IT

Job description

OCBC Group is seeking a Senior Data Engineer to design scalable data pipelines on a cloud platform, leveraging Spark, PySpark, and Iceberg. You will modernize data processing using cloud-native approaches and contribute to data governance with open catalogues.

The role emphasizes real-time streaming, SQL migration, and end-to-end ETL/ELT development with Python. Collaboration with analysts and data scientists is essential in delivering robust data solutions.