Senior Cloud Data Engineer: Pipelines, AI & Lakehouse

QUESS SELECTION & SERVICES PTE. LTD.; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

QUESS SELECTION & SERVICES PTE. LTD. is seeking a data platform engineer to design, build, and operate scalable data pipelines across AWS cloud and hybrid environments in Singapore.

You will implement ETL/ELT workflows with Python, PySpark, SQL, and cloud-native tools, develop lakehouse architectures, and ensure reliability, security, and cost controls. The role emphasizes collaboration with cross-functional teams to modernize platforms, automate processes, and deliver production-grade data

Qualifications

• 3–5+ years of hands-on experience developing and supporting production-grade data pipelines using SQL, Python, and cloud technologies.

Responsibilities

• Design, develop, and maintain scalable data pipelines and platform solutions across AWS cloud and hybrid/on-premises environments.
• Build and optimize ETL/ELT workflows using Python, PySpark, SQL, and cloud-native technologies.
• Develop and support data lakes, lakehouse architectures, metadata management, search platforms, and AI-enabled services.
• Implement and maintain CI/CD pipelines, automated testing frameworks, Infrastructure as Code (IaC), and deployment processes.
• Integrate and support AWS services and platform technologies, including OpenSearch, Amazon Bedrock, AgentCore, and Model Context Protocol (MCP).
• Monitor and optimize platform reliability, security, performance, observability, and cloud costs.
• Troubleshoot production issues, perform root cause analysis, and ensure platform stability and operational excellence.
• Collaborate with cross-functional teams to drive platform modernization, automation, and continuous improvement.

Skills

SQL

Python

PySpark

Apache Spark

Data engineering

Distributed processing

Tools

AWS

OpenSearch

Amazon Bedrock

AgentCore

MCP

Apache Airflow

dbt

Kafka/MSK

Iceberg

Hive

Trino

Presto

Git

CI/CD

IaC

Job description

QUESS SELECTION & SERVICES PTE. LTD. is seeking a data platform engineer to design, build, and operate scalable data pipelines across AWS cloud and hybrid environments in Singapore.

You will implement ETL/ELT workflows with Python, PySpark, SQL, and cloud-native tools, develop lakehouse architectures, and ensure reliability, security, and cost controls. The role emphasizes collaboration with cross-functional teams to modernize platforms, automate processes, and deliver production-grade data