Aws Data Engineer

Sightspectrum; Hyderabad, Chennai; Híbrido; INR 1 500 000 - 2 100 000; Tempo integral

Resumo da oferta

SightSpectrum Technologies is seeking an AWS Data Engineer to design and implement scalable ETL pipelines using AWS Glue, Spark, and PySpark. The role emphasizes real-time data processing and robust data modeling for data warehousing.

Based in Chennai or Hyderabad with a hybrid work model, the position requires 7+ years of hands-on AWS data engineering experience and strong Python skills. Relocation is not offered, and candidates must reside in the specified cities.

Qualificações

• Strong hands-on experience with AWS Glue, Apache Spark, and PySpark.
• Expertise in Spark architecture, performance tuning, and OOM issue resolution.
• Experience developing real-time ETL solutions using AWS Lambda.
• Strong programming skills in Python and PySpark.
• Hands-on experience with AWS services: S3, RDS, Redshift, IAM, and CloudWatch.
• Experience with Infrastructure as Code (IaC) using Terraform and CloudFormation.
• Strong SQL skills and knowledge of relational databases and data warehousing.
• Experience with PostgreSQL, MySQL, Oracle, and MongoDB.
• Strong understanding of data modeling, ETL best practices, and data warehousing.
• Experience with DevOps and CI/CD tools, including Docker, Git, Jenkins, and Terraform.

Conhecimentos

AWS Glue

Apache Spark

PySpark

Spark architecture

Performance tuning

OOM issue resolution

Real-time ETL

Python

AWS S3

AWS RDS

AWS Redshift

IAM

CloudWatch

Terraform

CloudFormation

SQL

Data warehousing

PostgreSQL

MySQL

Oracle

MongoDB

Data modeling

ETL best practices

DevOps

CI/CD

Docker

Git

Jenkins

Ferramentas

Docker

Git

Jenkins

Terraform

CloudFormation

Descrição da oferta de emprego

Were Hiring: AWS Data Engineer

SightSpectrum Technologies is looking for experienced AWS Data Engineers with strong expertise in AWS Glue, PySpark, Apache Spark, and scalable ETL pipeline development.

Location: Chennai / Hyderabad
Work Mode: Hybrid
Experience: 7+ Years
Notice Period: Immediate Joiners Only

Important: Candidates must currently be based in Chennai or Hyderabad. Relocation candidates will not be considered.

Mandatory Skills

• Strong hands-on experience with AWS Glue, Apache Spark, and PySpark
• Expertise in Spark architecture, performance tuning, and OOM issue resolution
• Experience developing real-time ETL solutions using AWS Lambda
• Strong programming skills in Python and PySpark
• Hands-on experience with AWS services: S3, RDS, Redshift, IAM, and CloudWatch
• Experience with Infrastructure as Code (IaC) using Terraform and CloudFormation
• Strong SQL skills and knowledge of relational databases and data warehousing
• Experience with PostgreSQL, MySQL, Oracle, and MongoDB
• Strong understanding of data modeling, ETL best practices, and data warehousing
• Experience with DevOps and CI/CD tools, including Docker, Git, Jenkins, and Terraform

Preferred Skills

• Experience designing cloud-native data platforms on AWS
• AWS Certification is an added advantage
• Strong troubleshooting, debugging, and performance optimization skills