AWS Data Engineers

Tap Growth ai; Singapore; On-site; SGD 90,000 - 180,000; Full time

Job summary

Tap Growth ai in Singapore seeks an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines and analytics solutions in a cloud-native environment.

You will work with PySpark, Python, and AWS services to develop ETL/ELT workflows, serverless components, and IaC-based infrastructure, ensuring performance, security, and cost efficiency.

Qualifications

• Strong hands-on experience with PySpark and Python for data engineering.
• Experience developing ETL pipelines using AWS Glue.
• Proficiency with AWS Step Functions for workflow orchestration.
• Experience building serverless solutions using AWS Lambda.
• Hands-on experience with Terraform for Infrastructure as Code (IaC).
• Experience implementing CI/CD pipelines using tools like GitLab, GitHub Actions, Jenkins, or similar.
• Good understanding of AWS services, data lakes, IAM, S3, CloudWatch, and monitoring.

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark on AWS.
• Build and orchestrate ETL/ELT workflows using AWS Glue and AWS Step Functions.
• Develop serverless applications and automation using AWS Lambda.
• Write clean, efficient Python/PySpark code following engineering best practices.
• Provision and manage cloud infrastructure using Terraform (IaC).
• Implement CI/CD pipelines to automate code deployment, testing, and infrastructure changes.
• Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and cost efficiency.
• Collaborate with business stakeholders to deliver data solutions.
• Follow DevOps, security, and coding standards throughout the engagement.

Skills

PySpark

Python

AWS Glue

AWS Step Functions

AWS Lambda

CI/CD

GitLab

GitHub Actions

Jenkins

Terraform

AWS services

S3

CloudWatch

Tools

Terraform

GitLab

GitHub Actions

Jenkins

Job description

We're Hiring: AWS Data Engineers!

We are looking for experienced AWS Data Engineers to join our dynamic team in Singapore. The ideal candidate will possess a strong background in data engineering, cloud technologies, and AWS services. You will play a crucial role in designing, building, and maintaining scalable data pipelines and solutions that drive business intelligence and analytics.

Location: Singapore, Singapore
Work Mode: Work from Office
Role: AWS Data Engineer

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark on AWS.
• Build and orchestrate ETL/ELT workflows using AWS Glue and AWS Step Functions.
• Develop serverless applications and automation using AWS Lambda.
• Write clean, efficient, and maintainable Python/PySpark code following engineering best practices.
• Provision and manage cloud infrastructure using Terraform (Infrastructure as Code).
• Implement and maintain CI/CD pipelines to automate code deployment, testing, and infrastructure changes.
• Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and cost efficiency.
• Collaborate with business stakeholders to deliver data solutions.
• Follow DevOps, security, and coding standards throughout the engagement.

Required Skills

• Strong hands-on experience with PySpark and Python for data engineering.
• Experience developing ETL pipelines using AWS Glue.
• Proficiency with AWS Step Functions for workflow orchestration.
• Experience building serverless solutions using AWS Lambda.
• Hands-on experience with Terraform for Infrastructure as Code (IaC).
• Experience implementing CI/CD pipelines using tools such as GitLab, GitHub Actions, Jenkins, or similar.
• Good understanding of AWS services, data lakes, IAM, S3, CloudWatch, and monitoring.