AWS Data Engineer

Cognizant; Singapore; On-site; SGD 110,000 - 170,000; Full time

Job summary

Cognizant Singapore is seeking an experienced data engineer to design, develop, and maintain scalable data pipelines using PySpark on AWS. You will build and orchestrate ETL/ELT workflows with AWS Glue and Step Functions, and develop serverless apps with AWS Lambda.

You will write clean Python/PySpark code, provision infrastructure with Terraform, and implement CI/CD pipelines to automate deployments. The role focuses on performance, reliability, cost efficiency, and collaboration with business

Qualifications

• Strong hands‑on experience with PySpark and Python for data engineering.
• Proficiency with AWS Step Functions for workflow orchestration.
• Experience building serverless solutions using AWS Lambda.
• Hands‑on experience with Terraform for Infrastructure as Code (IaC).
• Experience implementing CI/CD pipelines using tools such as GitLab, GitHub Actions, Jenkins, or similar.
• Good understanding of AWS services, data lakes, IAM, S3, CloudWatch, and monitoring.

Responsibilities

• Design, develop, and maintain scalable data pipelines on AWS.
• Build and orchestrate ETL/ELT workflows using AWS Glue and Step Functions.
• Develop serverless applications and automation using AWS Lambda.
• Provision and manage cloud infrastructure using Terraform (IaC).
• Implement CI/CD pipelines to automate deployment, testing, and infrastructure changes.
• Monitor, troubleshoot, and optimize pipelines for performance and cost efficiency.

Skills

PySpark

Python

Data engineering

CI/CD tooling

Tools

AWS

AWS Glue

AWS Step Functions

Terraform

Serverless

Job description

• Design, develop, and maintain scalable data pipelines using PySpark on AWS.
• Build and orchestrate ETL/ELT workflows using AWS Glue and AWS Step Functions.
• Develop serverless applications and automation using AWS Lambda.
• Write clean, efficient, and maintainable Python/PySpark code following engineering best practices.
• Provision and manage cloud infrastructure using Terraform (Infrastructure as Code).
• Implement and maintain CI/CD pipelines to automate code deployment, testing, and infrastructure changes.
• Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and cost efficiency.
• Collaborate with business stakeholders to deliver data solutions.
• Follow DevOps, security, and coding standards throughout the engagement.

Required Skills

• Strong hands‑on experience with PySpark and Python for data engineering.
• Proficiency with AWS Step Functions for workflow orchestration.
• Experience building serverless solutions using AWS Lambda.
• Hands‑on experience with Terraform for Infrastructure as Code (IaC).
• Experience implementing CI/CD pipelines using tools such as GitLab, GitHub Actions, Jenkins, or similar.
• Good understanding of AWS services, data lakes, IAM, S3, CloudWatch, and monitoring.