Data Engineer

Astek; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Astek is seeking an experienced Data Platform Engineer to support the development and operations of Data Warehouse. The role focuses on building and maintaining scalable data pipelines, ETL/ELT workflows, data platforms, and analytics engineering solutions, while providing ongoing production support.

You will collaborate with data and engineering teams to automate deployment, monitoring, and operations, optimise storage and query performance, and contribute to data governance and testing.

Qualifications

• Degree in Computer Science, Information Technology, or related discipline.
• ,

Responsibilities

• Develop and maintain data pipelines, ETL/ELT processes, and analytics engineering workflows to support advanced data search and retrieval.
• Collaborate with data and engineering teams to automate deployment, monitoring, and operational processes.
• Optimise data storage, processing, and query performance while troubleshooting technical issues.
• Coordinate with data engineers and stakeholders to support sprint planning and timely delivery.
• Perform BAU monitoring, investigation, troubleshooting, and incident resolution.
• Support data governance and data management initiatives.
• Provide day‑to‑day production and application support, ensuring platform stability and reliability.
• Develop and maintain unit and integration tests to ensure data and application quality.

Skills

Python

ETL

Unit and integration testing

Agile methodologies

Communication

Collaboration

Education

Degree in Computer Science or Information Technology

Tools

AWS

Kubernetes (K8s)

Snowflake

Databricks

Apache Spark

Apache Hive

Delta Lake

Apache Iceberg

Vector Databases

Apache Airflow

Dagster

Prefect

Temporal

GitHub workflows

Datadog

Job description

ASTEK has been providing IT and Engineering solutions for some of the world’s largest industrial and services groups for more than 35 years with 10,000 passionate experts in 22 countries throughout Europe, APAC, Middle East and the Americas

Role Overview

We are looking for an experienced Data Platform Engineer to support the development and operations of Data Warehouse. The role will focus on building and maintaining scalable data pipelines, ETL/ELT workflows, data platforms, and analytics engineering solutions, while providing ongoing production and application support.

Key Responsibilities

• Develop and maintain data pipelines, ETL/ELT processes, and analytics engineering workflows to support advanced data search and retrieval.
• Collaborate with data and engineering teams to understand requirements and automate deployment, monitoring, and operational processes.
• Optimise data storage, processing, and query performance while troubleshooting technical issues.
• Coordinate with data engineers and stakeholders to support sprint planning and timely delivery.
• Perform BAU monitoring, investigation, troubleshooting, and incident resolution.
• Support data governance and data management initiatives.
• Provide day‑to‑day production and application support, ensuring platform stability and reliability.
• Develop and maintain unit and integration tests to ensure data and application quality.

Requirements

• Degree in Computer Science, Information Technology, or a related discipline.
• At least 5 years of hands‑on Software Engineering or Data Engineering experience.
• Strong programming experience in Python and ETL
• Strong experience with unit and integration testing.
• Experience with AWS and Kubernetes (K8s).
• Familiarity with modern data platforms and technologies such as Snowflake, Databricks, Apache Spark, Apache Hive, Delta Lake, Apache Iceberg, and vector databases.
• Experience with workflow/orchestration technologies such as Apache Airflow, Dagster, Prefect, or Temporal.
• Familiarity with GitHub workflows, Datadog, DevOps practices, and Agile methodologies.
• Good analytical, troubleshooting, communication, and collaboration skills.

Key Technologies

Python | AWS | Kubernetes | Snowflake | Databricks | Apache Spark | Apache Hive | Delta Lake | Apache Iceberg | Vector Databases | Airflow | Dagster | Prefect | Temporal | GitHub | Datadog | ETL/ELT