AWS Data Engineer

nSearch Global Pte Ltd.; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

nSearch Global Pte Ltd is seeking a data engineer to design and implement scalable ETL/ELT pipelines on AWS, leveraging Glue, Lambda, Step Functions and S3. You will architect data lakehouse solutions with Apache Iceberg, enabling schema evolution and ACID transactions.

You will optimize pipelines for performance and cost, define data quality metrics, and work with cross-functional teams to deliver reliable data platforms using Terraform or CloudFormation for infrastructure as code.

Qualifications

• Degree in Computer Science, Data Engineering, Information Systems, or related with 3-5 years of experience in data engineering or data platform roles.
• Hands-on experience with AWS services and proficiency in Apache Iceberg or similar open table formats.
• AWS certifications such as AWS Certified Data Analytics or AWS Certified Solutions Architect are an advantage.
• Ability to design scalable, reliable data pipelines using modern data lakehouse architectures including Iceberg and S3 tables.
• Ability to work effectively in cross-functional teams and communicate technical concepts clearly to non-technical stakeholders.

Responsibilities

• Design and implement scalable ETL/ELT pipelines using AWS services including Glue, Step Functions, Lambda, and S3.
• Architect and build data lakehouse solutions leveraging Apache Iceberg or S3 tables with schema evolution and ACID transactions.
• Ensure pipelines are optimized for performance, cost, and reliability at scale.
• Define, implement, and maintain automated data quality validation frameworks with metrics and monitoring.
• Enforce data governance standards and ensure compliance across the data platform.
• Write production-quality code and deploy solutions on AWS cloud infrastructure.
• Work with DevOps practices including CI/CD pipelines and infrastructure-as-code tools such as Terraform or CloudFormation.
• Collaborate with cross-functional teams and communicate technical designs clearly to non-technical stakeholders.

Skills

AWS

ETL/ELT

Data Pipelines

Iceberg

Terraform

CloudFormation

Data Governance

CI/CD

Education

Bachelor's degree in Computer Science

Tools

AWS Glue

Lambda

Step Functions

S3

Apache Iceberg

Job description

Our client, one of Asia-Pacific’s leading organizations is looking for:

Responsibilities:

• Design and implement scalable ETL/ELT pipelines using AWS services including Glue, Step Functions, Lambda, and S3
• Architect and build data lakehouse solutions leveraging Apache Iceberg or S3 tables, incorporating features such as schema evolution, partition evolution, and ACID transactions
• Ensure pipelines are optimised for performance, cost, and reliability at scale
• Define, implement, and maintain automated data quality validation frameworks, establishing metrics and monitoring to ensure data accuracy, completeness, and consistency
• Enforce data governance standards and ensure compliance across the data platform
• Write production-quality code and deploy solutions on AWS cloud infrastructure
• Work with DevOps practices including CI/CD pipelines and infrastructure-as-code tools such as Terraform or CloudFormation to ensure repeatable and auditable deployment
• Work closely with cross-functional teams and communicate technical designs clearly to non-technical stakeholders

Requirements:

• Degree in Computer Science, Data Engineering, Information Systems, or a related with 3 - 5 years of experience in data engineering, ETL/ELT development, or data platform roles is expected
• Strong hands-on experience with AWS services and proficiency in Apache Iceberg or similar open table formats is essential
• AWS certifications such as AWS Certified Data Analytics or AWS Certified Solutions Architect are an advantage
• Ability to design and build scalable, reliable data pipelines using modern data lakehouse architectures including Apache Iceberg and S3 tables
• Ability to work effectively in cross-functional teams and communicate technical concepts clearly to non-technical stakeholders

EA License Number: 10C3636

By submitting your resume and cover letter to apply for our job opening, you confirm that you have read the Data Protection Notice for Job Applicants (https://www.nsearchglobal.com/dp-notice/job-applicants) and you consent to the collection, use, and disclosure of your personal data for the purpose of verifying and evaluating your job application. Additionally, you have to notify and obtain consent from all individuals listed as your references to their data being collected and disclosed for the purposes related to your job application