Data Engineer - Platform

Quess Selection & Services; Singapore; On-site; SGD 120,000 - 160,000; Full time

Job summary

Quess Singapore is seeking a motivated Data Platform Engineer to join the Data Engineering team in Singapore. The role focuses on building and operating an enterprise-scale Data Lake and Data Platform supporting analytics, ML, and AI across cloud and on‑prem environments.

You will design scalable data pipelines, manage AWS-based services, Python, PySpark and SQL, and contribute to automation, CI/CD, and production support while ensuring security, observability, and cost efficiency.

Qualifications

• 3–5+ years building production data pipelines.
• Experience with AWS and hybrid cloud environments.
• Unix/Linux administration and scripting.

Responsibilities

• Design, develop, and maintain scalable data platform solutions across AWS and hybrid/on-premises environments.
• Build, optimize, and support production-grade data pipelines using Python, PySpark, SQL, and cloud-native technologies.
• Implement and maintain ETL/ELT workflows, Data Lake/Lakehouse architectures, metadata management, search platforms, and AI services.
• Develop and maintain CI/CD pipelines, automated testing frameworks, deployment workflows, and infrastructure automation.
• Implement, integrate, and support AWS services and technologies such as OpenSearch, Amazon Bedrock, AgentCore, MCP, and related platform components.
• Monitor and optimize platform performance, reliability, security, observability, and cost efficiency.
• Troubleshoot production incidents, perform root-cause analysis, and ensure platform stability and operational excellence.
• Collaborate with data engineering, infrastructure, security, and application teams to drive platform modernisation and continuous improvement.

Skills

Python

SQL

PySpark

AWS

Linux/Unix

Shell scripting

Data pipelines

Automation

Tools

OpenSearch

Amazon Bedrock

IaC (Terraform)

Git

CI/CD pipelines

Job description

We are looking for a motivated Data Platform Engineer to join Data Engineering team in Singapore. The team designs, operates, and enhances an enterprise-scale Data Lake and Data Platform supporting analytics, reporting, machine learning, enterprise search, and AI-driven solutions across cloud and on-premises environments.

The successful candidate will build and maintain scalable, secure, and reliable data pipelines and platform services, with a strong focus on AWS, Python, PySpark, SQL, automation, and production support.

Key Responsibilities

• Design, develop, and maintain scalable data platform solutions across AWS and hybrid/on-premises environments.
• Build, optimize, and support production-grade data pipelines using Python, PySpark, SQL, and cloud-native technologies.
• Implement and maintain ETL/ELT workflows, Data Lake/Lakehouse architectures, metadata management, search platforms, and AI services.
• Develop and maintain CI/CD pipelines, automated testing frameworks, deployment workflows, and infrastructure automation.
• Implement, integrate, and support AWS services and technologies such as OpenSearch, Amazon Bedrock, AgentCore, MCP, and related platform components.
• Monitor and optimize platform performance, reliability, security, observability, and cost efficiency.
• Troubleshoot production incidents, perform root-cause analysis, and ensure platform stability and operational excellence.
• Collaborate with data engineering, infrastructure, security, and application teams to drive platform modernisation and continuous improvement.

Mandatory Requirements

• 3-5+ years of hands-on experience building and supporting production-grade data pipelines using SQL, Python, and cloud technologies.
• Practical experience with AWS and/or hybrid cloud environments.
• Strong Linux/Unix administration, shell scripting, troubleshooting, and production support capabilities.
• Solid understanding of data engineering principles, ETL/ELT processes, and distributed data processing.

Technical Skills

• AWS & Data Platforms: AWS Glue, EMR, S3, Redshift, Lambda
• Search & AI Platforms: OpenSearch, Amazon Bedrock, AgentCore, MCP
• DevOps & Automation: Git, CI/CD pipelines, Infrastructure as Code (IaC), automated testing, deployment automation

Preferred Qualifications

• Experience with enterprise Data Lake and Lakehouse platforms.
• Knowledge of streaming and event-driven architectures.
• Hands-on experience with OpenSearch administration, performance optimisation, and tuning.
• Familiarity with monitoring, observability, and production support tools.
• Understanding of data governance, security, access controls, and Personally Identifiable Information (PII) protection.
• Experience in banking, insurance, or other financial services environments.

EA License Number: 23C2060 Registration ID is R22109715

Disclaimer: The company is committed to ensuring the privacy and security of your information. By submitting this form, you consent to the collection, processing, and retention of the information you provide. The data collected (which may include your contact details, educational background, work experience and skills) will be used solely for the purpose of evaluating your qualifications for the position you're applying for. Your data will be stored securely and retained for the duration necessary to fulfill our hiring process. If you are not selected for the position, your data will be kept on file for a limited period in case future opportunities arise. You have the right to access, correct, or delete your data at any time by contacting us at Quess Singapore | A Leading Staffing Services Provider in Singapore (quesscorp.sg)

This is in partnership with the Employment and Employability Institute Pte Ltd ("e2i").

e2i is the empowering network for workers and employers seeking employment and employability solutions. e2i serves as a bridge between workers and employers, connecting with workers to offer job security through job-matching, career guidance and skills upgrading services, and partnering employers to address their manpower needs through recruitment, training, and job redesign solutions. e2i is a tripartite initiative of the National Trades Union Congress set up to support nation-wide manpower and skills upgrading initiatives. By applying for this role, you consent to Quesscorp Singapore's PDPA and e2i's PDPA