Senior Data Engineer: AI-Driven Data Lake on AWS

R Systems; Kuala Lumpur; On-site; MYR 180,000 - 260,000; Full time

Job summary

R Systems in Kuala Lumpur is seeking an experienced Senior Data Engineer to join our Data & Analytics team within the Insurance domain. You will design and build scalable data pipelines and cloud-native platforms on AWS, with a focus on Data Lake/Data Warehouse, ETL/ELT, PySpark, Python, and Apache Iceberg.

You will collaborate with architects, analysts, BI developers, and business stakeholders; mentor junior engineers; develop batch and near real-time processing; implement data governance and

Qualifications

• 3+ years of experience in Data Engineering, Data Warehousing, or Data Platform Engineering
• Strong hands-on experience with SQL, Python, PySpark, and Terraform
• Experience designing and supporting Enterprise Data Lake & Data Warehouse solutions
• Hands-on experience with Apache Iceberg
• Strong understanding of ETL/ELT, data modeling, and data integration
• Experience with Terraform / Infrastructure as Code
• Understanding of cloud security, IAM, permissions, and access control
• Experience supporting Disaster Recovery and Business Continuity activities
• Knowledge of Generative AI, Agentic AI, and AI-assisted software development
• Experience using AI-powered coding assistants to improve engineering productivity and code quality
• Strong analytical, troubleshooting, communication, and problem-solving skills

Responsibilities

• Design and develop scalable, secure, and high-performing data pipelines
• Build and optimize ETL/ELT processes across Data Lake and Data Warehouse environments
• Develop batch and near real-time data processing solutions
• Design and maintain Apache Iceberg datasets
• Build and support cloud-native data platforms on AWS
• Monitor, troubleshoot, and optimize data pipelines and platform performance
• Support Disaster Recovery (DR), failover/failback, RTO/RPO, and business continuity
• Implement data quality, reconciliation, governance, and metadata management controls
• Support AWS DataZone initiatives and enterprise data governance
• Collaborate with Architects, Business Analysts, Data Analysts, BI Developers, Product Owners, and business stakeholders
• Prepare technical documentation, runbooks, solution designs, and data flow diagrams
• Conduct knowledge transfer sessions and mentor junior engineers

Skills

AWS

Data Lake/Data Warehouse

ETL/ELT

PySpark

Python

SQL

Terraform

Apache Iceberg

AI-enabled software development

Data governance

Tools

Terraform

Apache Iceberg

AWS

Job description

R Systems in Kuala Lumpur is seeking an experienced Senior Data Engineer to join our Data & Analytics team within the Insurance domain. You will design and build scalable data pipelines and cloud-native platforms on AWS, with a focus on Data Lake/Data Warehouse, ETL/ELT, PySpark, Python, and Apache Iceberg.

You will collaborate with architects, analysts, BI developers, and business stakeholders; mentor junior engineers; develop batch and near real-time processing; implement data governance and