Senior Data Engineer — AWS Data Platform & AI Pipelines

New Era Technology PH; Kuala Lumpur; On-site; MYR 180,000 - 300,000; Full time

Job summary

New Era Technology is seeking a Senior Data Engineer to be deployed at our client’s Kuala Lumpur office. You will design, develop, and maintain scalable data platforms to support enterprise reporting, analytics, and regulatory requirements in the Insurance domain.

The role requires strong expertise in AWS cloud technologies, data lake/warehouse architectures, ETL/ELT development, IaC (Terraform), data governance, disaster recovery, and AI-enabled software development practices.

Qualifications

• Bachelor’s degree in computer science/IT/data engineering or related field.
• Minimum 3+ years of experience in Data Engineering, Data Warehousing, Data Platform Engineering, or related roles.
• Strong hands-on experience with SQL, Python, PySpark and Terraform.
• Experience with AWS services including AWS Glue, Amazon Redshift, Amazon S3, Amazon RDS, Amazon SNS, AWS Step Functions, Amazon CloudWatch, AWS IAM, Amazon EventBridge, AWS DataZone.
• Experience designing and supporting Data Lake and Data Warehouse solutions and working with Apache Iceberg.

Responsibilities

• Design, develop, and maintain scalable, reliable data pipelines for analytics and reporting.
• Build and optimize ETL/ELT processes to ingest, transform, and deliver data into Data Lake and Data Warehouse environments.
• Design, implement, and maintain cloud-native data solutions on AWS; develop IaC with Terraform.
• Develop scalable batch and near real-time data processing solutions and maintain Iceberg datasets.
• Support enterprise reporting, analytics, and regulatory data requirements; ensure data quality and governance.
• Lead knowledge transfer and documentation efforts; collaborate with stakeholders to deliver data requirements.

Education

Bachelor’s degree in computer science, information technology, data engineering, engineering, information systems, or related

Tools

SQL

Python

PySpark

Terraform

Job description

New Era Technology is seeking a Senior Data Engineer to be deployed at our client’s Kuala Lumpur office. You will design, develop, and maintain scalable data platforms to support enterprise reporting, analytics, and regulatory requirements in the Insurance domain.

The role requires strong expertise in AWS cloud technologies, data lake/warehouse architectures, ETL/ELT development, IaC (Terraform), data governance, disaster recovery, and AI-enabled software development practices.