Aws Data Engineer

Pi Square Technologies; Hyderabad, Bengaluru; Sur place; INR 1 000 000 - 1 800 000; Plein temps

Résumé du poste

Pi Square Technologies is seeking a hands-on AWS data engineer to design and implement scalable data pipelines. You will work with S3, Glue, Databricks and Delta Lake to enable analytics and reporting across client projects.

The role requires strong Python, PySpark and SQL skills, plus experience building CI/CD pipelines in AWS and managing IaC with Terraform or CloudFormation. Collaboration with clients and teams is essential.

Qualifications

• Hands-on AWS data engineering experience with S3 and Glue.
• Proficient in Python, PySpark and SQL.
• Experience with Databricks and Delta Lake for data processing.
• Data modeling experience for analytics and reporting use cases.
• Experience implementing CI/CD pipelines in AWS using CodePipeline, CodeBuild or CodeDeploy.
• Working knowledge of Git and Infrastructure as Code using Terraform or CloudFormation.
• Good communication, problem-solving and client-interaction skills.

Responsabilités

• Hands-on AWS data engineering using S3 and Glue.
• Develop data pipelines with PySpark and SQL.
• Work with Databricks and Delta Lake for processing.
• Model data for analytics and reporting use cases.
• Implement CI/CD pipelines in AWS using CodePipeline/CodeBuild/CodeDeploy.
• Use Git and IaC tools Terraform or CloudFormation.
• Communicate effectively with clients and teams.

Connaissances

Python

PySpark

SQL

Communication skills

Client interaction

Outils

AWS S3

AWS Glue

Databricks

Delta Lake

CodePipeline

CodeBuild

CodeDeploy

Terraform

CloudFormation

Git

Description du poste

Role & responsibilities

Strong hands-on AWS data engineering experience, including AWS S3 and AWS Glue.

• Hands-on coding proficiency in Python, PySpark and SQL.
• Experience in Databricks and Delta Lake-based data processing.
• Practical data-modeling experience for analytics and reporting use cases.
• Experience implementing CI/CD pipelines in AWS using CodePipeline, CodeBuild, CodeDeploy or equivalent tools.
• Working knowledge of Git and Infrastructure as Code using Terraform or AWS CloudFormation.
• Good communication, problem-solving and client-interaction skills.