Data Platform Engineer — AWS, PySpark & Lakehouse

Quesscorp Singapore Pte Ltd; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Quesscorp Singapore Pte Ltd is actively seeking a Data Platform Engineer to join our Data Engineering team in Singapore. You will build and maintain scalable data pipelines and platform services across AWS and hybrid environments, with a strong focus on Python, PySpark, SQL, and automation.

The role emphasizes production support, data lakehouse architectures, and cost-efficient operations, with exposure to OpenSearch, Bedrock, and related platform components.

Qualifications

• 3-5+ years hands-on experience building/ supporting production-grade data pipelines.
• Practical experience with AWS and hybrid cloud environments.
• Strong Linux/Unix administration, shell scripting, troubleshooting, and production support.
• Solid understanding of data engineering, ETL/ELT, and distributed processing.

Responsibilities

• Design, develop, and maintain scalable data platform solutions across AWS and hybrid/on-premises environments.
• Build, optimize, and support production-grade data pipelines using Python, PySpark, SQL, and cloud-native technologies.
• Implement and maintain ETL/ELT workflows, Data Lake/Lakehouse architectures, metadata management, search platforms, and AI services.
• Develop and maintain CI/CD pipelines, automated testing frameworks, deployment workflows, and infrastructure automation.
• Implement, integrate, and support AWS services and technologies such as OpenSearch, Amazon Bedrock, AgentCore, MCP, and related platform components.
• Monitor and optimize platform performance, reliability, security, observability, and cost efficiency.
• Troubleshoot production incidents, perform root-cause analysis, and ensure platform stability and operational excellence.
• Collaborate with data engineering, infrastructure, security, and application teams to drive platform modernization and continuous improvement.

Skills

Data platform design

ETL/ELT concepts

Production support

Tools

Python

PySpark

SQL

Apache Spark

AWS Glue

EMR

S3

Redshift

Lambda

Airflow

dbt

Kafka/MSK

Apache Iceberg

Hive

Trino

Presto

OpenSearch

Amazon Bedrock

AgentCore

MCP

Git

CI/CD

IaC

Datadog

CloudWatch

Grafana

Prometheus

Job description

Quesscorp Singapore Pte Ltd is actively seeking a Data Platform Engineer to join our Data Engineering team in Singapore. You will build and maintain scalable data pipelines and platform services across AWS and hybrid environments, with a strong focus on Python, PySpark, SQL, and automation.

The role emphasizes production support, data lakehouse architectures, and cost-efficient operations, with exposure to OpenSearch, Bedrock, and related platform components.