Data Platform Engineer – AWS, Data Lake & AI Pipelines

Quess Selection & Services; Singapore; On-site; SGD 120,000 - 160,000; Full time

Job summary

Quess Singapore is seeking a motivated Data Platform Engineer to join the Data Engineering team in Singapore. The role focuses on building and operating an enterprise-scale Data Lake and Data Platform supporting analytics, ML, and AI across cloud and on‑prem environments.

You will design scalable data pipelines, manage AWS-based services, Python, PySpark and SQL, and contribute to automation, CI/CD, and production support while ensuring security, observability, and cost efficiency.

Qualifications

• 3–5+ years building production data pipelines.
• Experience with AWS and hybrid cloud environments.
• Unix/Linux administration and scripting.

Responsibilities

• Design, develop, and maintain scalable data platform solutions across AWS and hybrid/on-premises environments.
• Build, optimize, and support production-grade data pipelines using Python, PySpark, SQL, and cloud-native technologies.
• Implement and maintain ETL/ELT workflows, Data Lake/Lakehouse architectures, metadata management, search platforms, and AI services.
• Develop and maintain CI/CD pipelines, automated testing frameworks, deployment workflows, and infrastructure automation.
• Implement, integrate, and support AWS services and technologies such as OpenSearch, Amazon Bedrock, AgentCore, MCP, and related platform components.
• Monitor and optimize platform performance, reliability, security, observability, and cost efficiency.
• Troubleshoot production incidents, perform root-cause analysis, and ensure platform stability and operational excellence.
• Collaborate with data engineering, infrastructure, security, and application teams to drive platform modernisation and continuous improvement.

Skills

Python

SQL

PySpark

AWS

Linux/Unix

Shell scripting

Data pipelines

Automation

Tools

OpenSearch

Amazon Bedrock

IaC (Terraform)

Git

CI/CD pipelines

Job description

Quess Singapore is seeking a motivated Data Platform Engineer to join the Data Engineering team in Singapore. The role focuses on building and operating an enterprise-scale Data Lake and Data Platform supporting analytics, ML, and AI across cloud and on‑prem environments.

You will design scalable data pipelines, manage AWS-based services, Python, PySpark and SQL, and contribute to automation, CI/CD, and production support while ensuring security, observability, and cost efficiency.