AWS Data Engineer - Manager

Talent Worx; Maharashtra; On-site; INR 1,500,000 - 2,500,000; Full time

Benefits offered by this job

Work with one of the Big 4's in India

Job summary

A top-tier consultancy firm is seeking an experienced AWS Data Engineer to design and implement data pipelines and analytics solutions using various AWS services. The ideal candidate will have 8-12 years of experience, with a strong focus on AWS services such as Glue, EMR, and Lambda. This role offers a full-time position with competitive benefits within a dynamic IT services environment. Locations include Bangalore, Coimbatore, Delhi NCR, and Mumbai.

Qualifications

• 8-12 years of experience required.
• At least 60% experience focused on AWS.
• Proficiency in AWS data services.
• Experience with Delta Lake technologies.
• Expertise in Aurora, RDS, DynamoDB.

Responsibilities

• Design and implement high-performance data pipelines.
• Develop and optimize ETL processes using AWS Glue and EMR.
• Build and maintain data lakes with S3 and Delta Lake.
• Create analytics solutions using Amazon Athena and Redshift.
• Collaborate with data scientists for their data needs.

Skills

AWS Services expertise

Python programming

Data Lake architectures

Big Data technologies

SQL skills

ETL processes

Education

Bachelor's degree in computer science or related field

Tools

AWS Glue

AWS EMR

AWS Lambda

AWS Athena

AWS Redshift

PostgreSQL

Git

Job description

We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services.

Key Responsibilities

• Design and implement scalable, high‑performance data pipelines using AWS services.
• Develop and optimize ETL processes using AWS Glue, EMR, and Lambda.
• Build and maintain data lakes using S3 and Delta Lake.
• Create and manage analytics solutions using Amazon Athena and Redshift.
• Design and implement database solutions using Aurora, RDS, and DynamoDB.
• Develop serverless workflows using AWS Step Functions.
• Write efficient and maintainable code using Python/PySpark, and SQL/PostgreSQL.
• Ensure data quality, security, and compliance with industry standards.
• Collaborate with data scientists and analysts to support their data needs.
• Optimize data architecture for performance and cost efficiency.
• Troubleshoot and resolve data pipeline and infrastructure issues.

Technical Skills

• AWS Services: Glue, EMR, Lambda, Athena, Redshift, S3, Aurora, RDS, DynamoDB, Step Functions.
• Big Data: Hadoop, Spark, Delta Lake.
• Programming: Python, PySpark.
• Databases: SQL, PostgreSQL, NoSQL.
• Data Warehousing and Analytics.
• ETL/ELT processes.
• Data Lake architectures.
• Version control: Git.
• Agile methodologies.

Required Qualifications

• 8‑12 years of experience.
• Locations: Bangalore, Coimbatore, Delhi NCR, Mumbai.
• Bachelor's degree in computer science, information technology, or related field.
• At least 60% of experience focused on AWS.
• Strong proficiency in AWS data services: Glue, EMR, Lambda, Athena, Redshift, S3.
• Experience with data lake technologies, particularly Delta Lake.
• Expertise in database systems: Aurora, RDS, DynamoDB, PostgreSQL.
• Proficiency in Python and PySpark programming.
• Strong SQL skills and experience with PostgreSQL.

Benefits

Work with one of the Big 4's in India.

Seniority Level

Mid‑Senior level

Employment Type

Full‑time

Job Function

Other

Industries

IT Services and IT Consulting