Data Engineer Lead

DCS Card Centre; Singapore; On-site; SGD 70,000 - 100,000; Full time

Job summary

A leading fintech company is seeking a skilled Data Engineer to develop a financial-grade real-time data platform. The role involves managing petabyte-scale data, integrating cloud-native solutions, and collaborating with multiple teams to enhance data usability and compliance. Candidates with over 5 years of experience in data engineering, especially within the fintech or payment sector, are encouraged to apply.

Qualifications

• Over 5 years of experience in data engineering or data warehousing.
• Familiar with mainstream big data technology stacks and performance tuning.
• Preferred background in payments, finance, or internet industries.

Responsibilities

• Lead the development of a data platform covering data collection, storage, and computation layers.
• Establish a cloud-native data warehouse system integrated with Spark/Flink.
• Interface with business to design data workflows complying with PCI DSS.

Skills

Data Engineering

Data Warehousing

Big Data Technologies

Data Modeling

Communication

Collaboration

Job description

Key Responsibilities:

• Lead the development of a financial-grade real-time data platform from 0 to 1 (covering data collection, storage, and computation layers), designing an architecture that supports daily processing of petabyte-scale transactional data.
• Establish a cloud-native (AWS) data warehouse system integrated with Spark/Flink for unified stream and batch processing, enabling millisecond-level metric computation for payment data.
• Interface with the company's full-stack business (e.g., acquiring and issuing) and design data masking workflows and audit solutions that comply with PCI DSS.
• Build and maintain data dashboards to support business teams in data-driven decision-making.
• Integrate with payment systems to ensure seamless data flow and consolidation.
• Responsible for data collection, processing, modeling, and structuring to improve data quality and usability.
• Support cross-departmental data needs and promote data standardization and automation.
• Work closely with teams such as risk control, compliance, and product to provide data support.

Requirements:

• Over 5 years of experience in data engineering or data warehousing, with the capability to independently build data platforms.
• Familiar with mainstream big data technology stacks, and proficient in performance tuning for Hadoop/Spark/Flink (e.g., shuffle optimization, checkpoint mechanism).
• Skilled in data modeling (Dimensional/Star Schema), ETL processes, and data governance.
• Preferred background in payments, finance, or internet industries; familiarity with payment data structures is a plus.
• Strong communication, collaboration, and business understanding skills, with the ability to work effectively with product, risk, and compliance teams.

Preferred Qualifications:

• Experience in data-related roles within fintech or payment companies
• Hands-on experience building data platforms or dashboards from scratch.
• Familiarity with compliance-related data processing policies and workflows.