Senior Data Engineer

PEOPLESEARCH PTE. LTD.; Singapore; On-site; SGD 90,000 - 120,000; Full time

Job summary

A leading technology recruitment firm based in Singapore is seeking a Senior Data Engineer. The successful candidate will operate within a collaborative and agile team, focusing on designing an enterprise data platform and managing robust data processing pipelines. Ideal candidates will have 8+ years of experience in data engineering, cloud services expertise, and advanced SQL skills.

Qualifications

• Minimum 8 years of experience in a Data Engineer role.
• Experience building and operating large-scale data lakes and data warehouses.
• Advanced working experience with relational SQL and NoSQL databases.

Responsibilities

• Design, develop, and test the deployment and operation phases of the Enterprise Data Platform.
• Implement data governance processes, including data quality management and profiling.
• Establish expertise in designing and troubleshooting large-scale distributed systems.

Skills

Data governance

SQL optimization

Building data lakes

Cloud services

Stream-processing systems

Tools

Hadoop

Spark-Streaming

Delta Lake

Databricks

Postgres

Job description

Senior Data Engineer

In view of business expansion, our client is seeking a Senior Data Engineer based in Singapore. It's an opportunity to spearhead cutting-edge work as part of a highly collaborative and agile team. You will design enterprise data platform, create and manage a single master record for the business entity, ensuring data consistency, accuracy, and reliability.

The Responsibilities:

• Design, develop, and test the deployment and operation phases of the Enterprise Data Platform for both current and future projects.
• Review, build, or restructure data architecture and ensure its ongoing maintenance and testing.
• Implement data governance processes, including data quality management, data profiling, data remediation, and automated data lineage.
• Create and maintain multiple robust and high-performance data processing pipelines within Cloud, Private Data Centre, and Hybrid data ecosystems.
• Assemble large, complex data sets from a wide variety of data sources.
• Develop, deploy, and maintain multiple microservices, REST APIs, and reporting services.
• Design and implement internal processes to automate manual workflows, optimize data delivery, and re-design infrastructure for greater scalability.
• Establish expertise in designing, analyzing, and troubleshooting large-scale distributed systems.

Requirements:

• Minimum 8 years of experience in a Data Engineer role.
• Experience building and operating large-scale data lakes and data warehouses.
• Experience with Hadoop ecosystem and big data tools.
• Experience in data governance, including data quality management, data profiling, data remediation, and automated data lineage.
• Experience with stream-processing systems including Spark-Streaming.
• Experience working with Cloud services using one or more Cloud providers.
• Experience with Delta Lake and Databricks.
• Advanced working experience with relational SQL and NoSQL databases, including Hive, HBase, and Postgres.
• Deep understanding of SQL and the ability to optimize data queries.
• Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc.

Office Location: Central, Singapore

We are an equal opportunities employer and welcome applications from all qualified candidates.