Data Engineer (AWS)

MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTD; Singapore; On-site; SGD 90,000 - 140,000; Full time

Job summary

MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTD is seeking a Data Engineer to design, develop, and maintain scalable data pipelines using PySpark on AWS. You will build ETL/ELT workflows with AWS Glue and AWS Step Functions, and develop serverless applications with AWS Lambda.

The role requires hands-on Python/PySpark coding, IaC with Terraform, and implementing CI/CD pipelines. You will monitor pipelines, optimize performance and costs, and collaborate with business stakeholders while following

Qualifications

• Bachelor’s degree in computer science or related field.
• 3+ years hands-on experience with PySpark and Python for data engineering.
• Experience developing ETL pipelines using AWS Glue.
• Proficiency with AWS Step Functions for workflow orchestration.
• Experience building serverless solutions using AWS Lambda.
• Hands-on experience with Terraform for IaC.
• Experience implementing CI/CD pipelines using GitLab, GitHub Actions, Jenkins, or similar.
• Strong understanding of AWS services (data lakes, IAM, S3, CloudWatch).

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark on AWS.
• Build and orchestrate ETL/ELT workflows with AWS Glue and Step Functions.
• Develop serverless applications and automation using AWS Lambda.
• Write clean Python/PySpark code following engineering best practices.
• Provision and manage cloud infrastructure using Terraform (IaC).
• Implement and maintain CI/CD pipelines to automate deployments.
• Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and cost.
• Collaborate with business stakeholders to deliver high-quality data solutions.
• Follow DevOps, security, and coding standards throughout the engagement.

Skills

PySpark

Python

AWS

ETL

CI/CD

Data pipelines

Education

Bachelor’s degree in computer science or related discipline

Tools

AWS Glue

AWS Step Functions

AWS Lambda

Terraform

GitLab

GitHub Actions

Jenkins

Job description

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark on AWS.


• Build and orchestrate ETL/ELT workflows using AWS Glue and AWS Step Functions.


• Develop serverless applications and automation using AWS Lambda.


• Write clean, efficient, and maintainable Python/PySpark code following engineering best practices.


• Provision and manage cloud infrastructure using Terraform (Infrastructure as Code).


• Implement and maintain CI/CD pipelines to automate code deployment, testing, and infrastructure changes.


• Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and cost efficiency.


• Collaborate with business stakeholders to deliver high-quality data solutions.


• Follow DevOps, security, and coding standards throughout the engagement.

Required Skills

• Bachelor’s degree in computer science or a related discipline.


• With around 3 plus years hands-on experience with PySpark and Python for data engineering.


• Experience developing ETL pipelines using AWS Glue.


• Proficiency with AWS Step Functions for workflow orchestration.


• Experience building serverless solutions using AWS Lambda.


• Hands-on experience with Terraform for Infrastructure as Code (IaC).


• Experience implementing CI/CD pipelines using tools such as GitLab, GitHub Actions, Jenkins, or similar.


• Good understanding of AWS services, including data lakes, IAM, S3, CloudWatch, and monitoring.

Please note that your response to this advertisement and communications with us pursuant to this advertisement will constitute informed consent to the collection, use and/or disclosure of personal data by ManpowerGroup Singapore for the purpose of carrying out its business, in compliance with the relevant provisions of the Personal Data Protection Act 2012. To learn more about ManpowerGroup’s Global Privacy Policy, please visit https://www.manpower.com.sg/privacy-policy