Aws Data Engineer-Immediate joiners(0-1week)-permanent

Innova Solutions; Hyderabad, Chennai District; Hybrid; INR 2,400,000 - 3,600,000; Full time

Job summary

Innova Solutions seeks a senior data engineer in Hyderabad or Chennai to design and build real-time ETL pipelines using PySpark, Python and AWS Glue. The candidate should bring 8+ years of experience in data warehousing, Spark-based architectures, and AWS services including Lambda, EMR, RDS and Redshift.

Strong SQL skills, database modeling expertise and experience with Terraform or CloudFormation are required to ensure scalable data platforms and efficient data processing.

Qualifications

• 8+ years of experience in data engineering and ETL development.
• Hands-on with PySpark, Python and Spark-based architectures.
• Proficient in AWS Glue, Lambda and EMR for real-time processing.
• Strong SQL and data warehousing concepts.
• Experience with Terraform or CloudFormation.
• Ability to handle large-scale data and optimize performance.

Responsibilities

• Design real-time ETL pipelines using PySpark and AWS Glue.
• Develop and optimize Spark-based architectures and data models.
• Engineer AWS-based data platform components (RDS, Redshift, IAM, CloudWatch).
• Collaborate with cross-functional teams in Hyderabad/Chennai.
• Ensure data quality, reliability and performance.

Skills

Python

PySpark

SQL

AWS Glue

Lambda

EMR

EC2

Tools

Terraform

CloudFormation

RDS

Redshift

IAM

CloudWatch

Job description

Preferred candidate profile

Python, Pyspark, SQL , AWS Glue, Lambda, EMR, EC2

Location : Hyderabad, Chennai

Years of exp : 8+ years

• 1 ) AWS Glue + Spark architecture + Handling OOM issues.
• 2) Lambda development (Real time ETL development).
• 3) PySpark and Python coding.
• 4) AWS services - Terraform, CloudFormation templates, RDS, Redshift, IAM and CloudWatch.
• 5) SQL
• 6) Strong understanding of Database and Datawarehouse concepts, Relational Data models