Senior Data Engineer – AWS Data Lake & Warehouse

Accord Innovations; Kuala Lumpur; Sur place; MYR 120 000 - 180 000; Plein temps

Résumé du poste

Accord Innovations in Kuala Lumpur, Malaysia is seeking a Senior Data Engineer to design, develop, and maintain scalable data platforms supporting enterprise analytics, reporting, regulatory requirements, and business decisions. The role focuses on AWS cloud technologies, data lake and data warehouse architectures, ETL/ELT, IaC using Terraform, data governance, and DR.

Build reliable pipelines, implement Iceberg datasets, and ensure quality, security, and high availability.

Qualifications

• Bachelor's degree in a relevant field or equivalent experience.
• Minimum 3+ years of experience in Data Engineering, Data Warehousing, Data Platform Engineering, or related roles.
• Strong hands-on experience with SQL, Python, PySpark, and Terraform.
• Proficient in AWS services including Glue, Redshift, S3, RDS, SNS, Step Functions, CloudWatch, IAM, EventBridge, DataZone.
• Experience designing and supporting enterprise Data Lake and Data Warehouse solutions.
• Familiarity with Iceberg tables and large-scale data processing platforms.
• Knowledge of ETL/ELT methodologies, data modeling, and data integration techniques.

Responsabilités

• Design, develop, and maintain scalable, reliable, and secure data pipelines for analytics and reporting.
• Build and optimize ETL/ELT processes to ingest, transform, and load data into Data Lake and Data Warehouse environments.
• Design, implement, and maintain cloud-native data solutions on AWS.
• Develop scalable batch and near real-time data processing solutions.
• Develop and maintain Apache Iceberg datasets for enterprise workloads.
• Ensure data quality, accuracy, and timeliness from source systems to Data Lake.
• Monitor, troubleshoot, and resolve data ingestion issues; perform root cause analysis.
• Collaborate with stakeholders to ensure regulatory and governance requirements are met.

Connaissances

SQL

Python

PySpark

Terraform

AWS

Data Lake/Warehouse design

ETL/ELT

Data Governance

Iceberg

DevOps

Formation

Bachelor's Degree in Computer Science, Information Technology, Data Engineering, Engineering, Information Systems, or related discipline

Outils

AWS Glue

Amazon Redshift

Amazon S3

Amazon RDS

Amazon SNS

AWS Step Functions

Amazon CloudWatch

AWS IAM

Amazon EventBridge

AWS DataZone

Apache Iceberg

Description du poste

Accord Innovations in Kuala Lumpur, Malaysia is seeking a Senior Data Engineer to design, develop, and maintain scalable data platforms supporting enterprise analytics, reporting, regulatory requirements, and business decisions. The role focuses on AWS cloud technologies, data lake and data warehouse architectures, ETL/ELT, IaC using Terraform, data governance, and DR.

Build reliable pipelines, implement Iceberg datasets, and ensure quality, security, and high availability.