Senior Cloud Data Platform Engineer (AWS & Lakehouse)

QUESS ENGINEERING PTE. LTD.; Singapore; On-site; SGD 90,000 - 140,000; Full time

Job summary

QUESS ENGINEERING PTE. LTD. is seeking a data engineering professional to design and implement scalable data solutions across AWS cloud and hybrid environments.

You will build production-grade pipelines using Python, PySpark, SQL and modern data tooling, while contributing to platform modernization and automation initiatives. You will optimise data lakes/lakehouses, support metadata management, and work with AI services, CI/CD pipelines, and observability tools to ensure reliable, secure

Qualifications

• 3–5+ years of hands-on data pipelines experience.
• Experience with AWS and/or hybrid cloud environments.
• Strong Linux/Unix administration and scripting.
• Understanding ETL/ELT, data integration, data quality.
• Experience with distributed data processing and Lakehouse architectures.
• Proficiency in Git, CI/CD, DevOps, and deployment processes.

Responsibilities

• Design, develop and implement scalable data and platform solutions across AWS cloud and hybrid/on-premises environments.
• Build, maintain and optimise production-grade data pipelines, platform services and automation frameworks using Python, PySpark, SQL and cloud-native technologies.
• Support and enhance enterprise data platforms, including data lakes, lakehouse architectures, metadata management, search platforms and AI services.
• Develop and maintain CI/CD pipelines, automated testing frameworks and deployment processes to ensure reliable and efficient software delivery.
• Implement, integrate and support technologies such as OpenSearch, Amazon Bedrock, AgentCore, MCP and related platform services.
• Monitor and improve platform reliability, security, performance, observability and cost efficiency.
• Troubleshoot and resolve production issues, perform root-cause analysis and ensure platform stability and operational excellence.
• Collaborate with cross-functional teams to drive platform modernisation, automation and continuous improvement initiatives.

Skills

SQL

Python

PySpark

Apache Spark

Airflow

Git

CI/CD

Linux/Unix

Scripting

Tools

AWS

OpenSearch

Kafka/MSK

DBT

Hive/Presto

Iceberg

Datadog

Grafana

Prometheus

Job description

QUESS ENGINEERING PTE. LTD. is seeking a data engineering professional to design and implement scalable data solutions across AWS cloud and hybrid environments.

You will build production-grade pipelines using Python, PySpark, SQL and modern data tooling, while contributing to platform modernization and automation initiatives. You will optimise data lakes/lakehouses, support metadata management, and work with AI services, CI/CD pipelines, and observability tools to ensure reliable, secure