Senior Data Engineer

OCBC Group; Singapore; On-site; SGD 90,000 - 150,000; Full time

Benefits offered by this job

Competitive base salary

Holistic benefits

Community initiatives

Learning & development opportunities

Job summary

OCBC Group is seeking a Senior Data Engineer to design scalable data pipelines on a cloud platform, leveraging Spark, PySpark, and Iceberg. You will modernize data processing using cloud-native approaches and contribute to data governance with open catalogues.

The role emphasizes real-time streaming, SQL migration, and end-to-end ETL/ELT development with Python. Collaboration with analysts and data scientists is essential in delivering robust data solutions.

Qualifications

• Minimum 3 years of relevant industry experience.
• Hands-on in cloud-native data engineering and data pipelines.
• Experience with Spark/PySpark and data governance concepts.

Responsibilities

• Design and build scalable data pipelines using cloud-native services.
• Develop real-time streaming pipelines and structured streaming logic.
• Migration of SQL workloads to cloud-native architectures.
• Create end-to-end ETL/ELT workflows with Python and shell scripting.
• Implement data governance with open catalogue frameworks.

Skills

Cloud-native

Spark

Python

Iceberg

SQL

Education

Bachelor's in Computer Science/IT

Job description

WHO WE ARE

As Singapore’s longest established bank, we have been dedicated to enabling individuals and businesses to achieve their aspirations since 1932. How? By taking the time to truly understand people. From there, we provide support, services, solutions, and career paths that meet their individual needs and desires. Today, we’re on a journey of transformation. Leveraging technology and creativity to become a future-ready learning organisation. But for all that change, our strategic ambition is consistently clear and bold, which is to be Asia’s leading financial services partner for a sustainable future. We invite you to build the bank of the future. Innovate the way we deliver financial services. Work in friendly, supportive teams. Build lasting value in your community. Help people grow their assets, business, and investments. Take your learning as far as you can. Or simply enjoy a vibrant, future-ready career. Your Opportunity Starts Here.

Senior Data Engineer

We are seeking a highly skilled and motivated Senior Data Engineer with expertise in cloud-native data engineering on any major cloud platform. The ideal candidate will have hands‑on experience with Spark, PySpark, Iceberg, streaming systems, and open data catalogue/governance frameworks. This role is suitable for individuals with minimum 3 years of relevant industry experience and have strong fundamentals, high learning agility, and a passion for building modern data systems.

Key Responsibilities

Cloud‑Native Data Engineering – Design and build scalable, reliable data pipelines using native services provided by the chosen cloud platform. Implement data lakehouse solutions using Apache Iceberg and open, interoperable metadata/catalogue frameworks. Modernize existing data processing pipelines with cloud‑first architectural principles.

Streaming & Real‑Time Processing – Develop and maintain real‑time streaming pipelines using the platform’s native streaming, messaging, and event ingestion services. Build structured streaming logic using Spark Structured Streaming or equivalent cloud‑native stream processing tools.

Migration & Modernization – Participate in the migration of complex SQL workloads and legacy processing systems into a cloud‑native architecture. Optimize SQL and transformation logic to leverage cloud‑scalable compute and storage.

Data Engineering & Automation – Build end‑to‑end ETL/ELT workflows using Python and Unix/Linux shell scripting. Write efficient SQL for complex data transformations and analytics. Develop automated data quality checks, validation processes, and operational monitoring.

Data Governance & Catalogue – Leverage open‑source catalogue/governance solutions (e.g., Open Data Catalogue, OpenMetadata, DataHub) to ensure lineage, metadata capture, and data accessibility. Support data governance practices across domains and teams.

Collaboration & Delivery – Work closely with analysts, data scientists, and stakeholders to deliver robust, scalable data solutions. Troubleshoot pipeline issues, ensure data reliability, and optimize processing performance. Continuously explore new technologies and best practices within the data engineering ecosystem.

Why Join

Imagine being part of a team that builds innovative digital solutions for one of Asia's leading banks. As a Software Engineer at OCBC, you'll have the opportunity to work on cutting‑edge projects that transform the way we deliver financial services. You'll be part of a collaborative team that values creativity, innovation, and continuous learning.

How you succeed

To succeed in this role, you'll need to be passionate about software development and committed to delivering high‑quality solutions. You'll work closely with cross‑functional teams to understand business requirements, design and develop software applications, and ensure seamless integration with existing systems. Your ability to collaborate, innovate, and adapt to changing requirements will be key to your success.

What you do

• Design, develop, and test software applications using various programming languages and technologies
• Collaborate with business stakeholders to understand requirements and develop solutions that meet their needs
• Work with cross‑functional teams to ensure seamless integration with existing systems
• Participate in code reviews and contribute to the improvement of the overall code quality
• Troubleshoot and resolve technical issues in a timely and efficient manner

Who you are

• A degree in Computer Science, Information Technology, or a related field
• At least 3 years of experience in software development, preferably in a banking or financial services environment
• Proficient in one or more programming languages, such as Java, Python, or C++
• Experience with Agile development methodologies and version control systems such as Git
• Strong problem‑solving skills, with the ability to analyze complex technical issues and develop creative solutions
• Excellent communication and collaboration skills, with the ability to work effectively with cross‑functional teams

What we offer

• Competitive base salary.
• A suite of holistic, flexible benefits to suit every lifestyle.
• Community initiatives.
• Industry‑leading learning and professional development opportunities.

Your wellbeing, growth and aspirations are every bit as cared for as the needs of our customers. Let’s build the bank we need for the future we want. Find the best version of yourself in a friendly, supportive team. Build lasting value in your community. Help people grow their assets, business, and investments. Take your learning as far as you can. Or simply enjoy a vibrant, future-ready career. Your Opportunity Starts Here.

As the longest established Singapore bank, formed in 1932 from the merger of three local banks, we have grown from strength to strength to become a regional financial services group. With a deep history in Asia, we offer the most comprehensive coverage across ASEAN and Greater China, complemented with a presence in the leading economies of New York, London and Sydney. We are the second largest financial services group in Southeast Asia by assets with one of the world’s highest credit rating (Aa1 by Moody’s and AA- by both Fitch and S&P). We offer private banking services through our wholly‑owned subsidiary, Bank of Singapore, which operates on a unique open‑architecture product platform to source for the best‑in‑class products to meet its clients’ goals. Our insurance subsidiary, Great Eastern Holdings, is the oldest and most established life insurance group in Singapore and Malaysia.