Data Engineer (Enterprise Data Platforms)

ES TECH CONSULTANCY PTE. LTD.; Singapore; On-site; SGD 70,000 - 90,000; Part time

Job summary

A technology consultancy firm in Singapore is seeking a skilled Data Engineer to support enterprise-scale data pipelines and analytics platforms. This role involves hands-on work with cloud infrastructure and governance tools to ensure high-quality data delivery for business insights. Candidates should have extensive experience with SQL, Apache Spark, and AWS services. The successful applicant will work in an Agile environment and is expected to contribute to designing and maintaining data governance practices. This is a contract position with opportunities for renewal.

Qualifications

• Bachelor’s degree in a relevant field.
• Minimum 7 years of experience in a Data Engineer role.
• Strong hands-on experience with Apache Spark and SQL.
• Experience with AWS cloud services, particularly S3 and EC2.
• Experience with workflow orchestration tools like Apache Airflow.
• Familiarity with Presto and distributed query engines.
• Experience with data governance tools, e.g., Collibra.
• Experience developing dashboards with Tableau.
• Ability to work effectively in Agile environments.

Responsibilities

• Design, develop, and maintain data pipelines using Apache Spark.
• Develop and optimise SQL queries for data manipulation.
• Utilise AWS services for scalable data processing.
• Implement data governance practices using Collibra.
• Orchestrate workflows using Apache Airflow.
• Build and maintain data pipelines with Hive SQL.
• Perform data analysis using Superset and Presto.
• Develop Tableau dashboards for data visualisation.

Skills

Apache Spark

SQL

AWS services

Apache Airflow

Tableau

Data governance

Agile methodologies

Education

Bachelor’s degree in Computer Science, Information Technology, Engineering

Tools

Collibra

Presto

Hive SQL

Superset

Job description

Overview

We are seeking a Data Engineer to support the design, development, and operation of enterprise-scale data pipelines and analytics platforms. This role involves working with cloud-based infrastructure, data governance tools, and analytics teams to ensure reliable, high-quality data delivery for business insights.

The successful candidate will be hands-on in data pipeline engineering, SQL development, workflow orchestration, and data governance implementation, operating within an Agile delivery environment.

Responsibilities

• Design, develop, and maintain data pipelines using Apache Spark for large-scale data processing and transformation
• Develop and optimise SQL queries to support complex data manipulation, analysis, and reporting
• Manage and utilise AWS services, including Amazon S3 and EC2, for scalable data storage and processing
• Implement and maintain metadata management and data governance practices using tools such as Collibra
• Enable interactive querying and analysis using Presto, supporting access across multiple data sources
• Orchestrate and automate workflows using Apache Airflow, ensuring reliable scheduling and execution
• Build and maintain data pipelines using Hive SQL on internal dataplatforms
• Perform data analysis using Superset with Presto as the backend query engine
• Develop Tableau dashboards and reports to support data visualisation and business insights
• Apply Agile methodologies to deliver iterative enhancements aligned with stakeholder requirements

Requirements

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or related discipline
• Min 7yrs work experience in a Data Engineer role supporting enterprise or large-scale data environments
• Strong hands-on experience with Apache Spark and SQL
• Working experience with AWS cloud services, particularly S3 and EC2
• Experience with workflow orchestration tools such as Apache Airflow
• Familiarity with Presto, Hive SQL, and distributed query engines
• Experience with data governance or metadata management tools (e.g. Collibra)
• Experience developing dashboards using Tableau
• Ability to work effectively in project-based and Agile environments

Additional Information

• Employment Type: Contract (1 Year, Renewable)
• Singaporeans to apply