AWS Data Engineer: PySpark Pipelines & Serverless Workflows

Cognizant Technology Solutions Asia Pacific Pte. Ltd.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Cognizant Technology Solutions Asia Pacific Pte. Ltd. is seeking a data engineering professional to design, build, and optimize scalable data pipelines on AWS using PySpark and Python. You will implement ETL/ELT workflows, serverless solutions, and IaC with Terraform while maintaining robust CI/CD processes.

Role focuses on data lake data engineering, cost-aware operations, and collaboration with business stakeholders to deliver secure, scalable data solutions in a cloud-first environment.

Qualifications

• Hands-on PySpark and Python data engineering experience.
• Experience ETL pipelines with AWS Glue.
• AWS Step Functions and Lambda/serverless development.
• Terraform IaC and CI/CD pipelines with GitLab/GitHub/Jenkins.

Responsibilities

• Design and maintain scalable data pipelines using PySpark on AWS.
• Build ETL/ELT workflows with AWS Glue and Step Functions.
• Develop serverless apps and automation with AWS Lambda.
• Write clean Python/PySpark code following best practices.
• Provision and manage cloud infrastructure with Terraform.
• Implement CI/CD pipelines to automate deployments and tests.
• Monitor and optimize data pipelines for performance and cost.
• Collaborate with stakeholders and follow DevOps standards.

Skills

PySpark

Python

AWS Services

CI/CD Practices

Workflow orchestration

Tools

Terraform IaC

GitHub Actions

GitLab

Jenkins

AWS Step Functions

Job description

Cognizant Technology Solutions Asia Pacific Pte. Ltd. is seeking a data engineering professional to design, build, and optimize scalable data pipelines on AWS using PySpark and Python. You will implement ETL/ELT workflows, serverless solutions, and IaC with Terraform while maintaining robust CI/CD processes.

Role focuses on data lake data engineering, cost-aware operations, and collaboration with business stakeholders to deliver secure, scalable data solutions in a cloud-first environment.