Lead AWS Data Engineer

Quest Global; Hyderabad; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Quest Global is hiring an AWS Lead Data Engineer to design and optimize scalable data platforms on AWS from Hyderabad. You will lead data engineering initiatives, mentor engineers, and deliver business-driven data solutions while ensuring data quality, security, and performance.

The role requires 7–12 years of data engineering, strong Python/SQL skills, and hands-on AWS experience including Glue, S3, Redshift, and Airflow.

Qualifications

• 7–12 years of Data Engineering experience.
• Strong hands-on experience with AWS Glue, S3, Redshift, Athena, EMR, Lambda, IAM, Step Functions, and CloudWatch.
• Strong programming skills in Python and SQL.
• Experience with Apache Airflow/MWAA.
• Knowledge of Data Lakes, Data Warehousing, and data modeling.
• Experience with Git, CI/CD, and Terraform/CloudFormation.
• Experience with Power BI, Tableau, or QuickSight.

Responsibilities

• Design and develop scalable data pipelines using AWS services.
• Build and optimize ETL/ELT workflows.
• Develop Data Lake and Data Warehouse solutions.
• Lead data engineering projects and mentor team members.
• Collaborate with stakeholders to deliver business-driven data solutions.
• Ensure data quality, security, and performance.

Skills

Python

SQL

Airflow

Data modeling

ETL/ELT

Git

CI/CD

Terraform/CloudFormation

Power BI/Tableau/QuickSight

Tools

AWS Glue

S3

Redshift

Athena

EMR

Lambda

IAM

Step Functions

CloudWatch

Snowflake

Databricks

Kafka

Kinesis

Git

CI/CD

Terraform

CloudFormation

Power BI

Tableau

QuickSight

Job description

AWS Lead Data Engineer

Location: Hyderabad (Work from Office)
Experience: 712 Years
Employment Type: Full-Time

Job Description

We are hiring an experienced AWS Lead Data Engineer to design, build, and optimize scalable data platforms on AWS. The ideal candidate should have strong expertise in data engineering, ETL development, cloud data services, and leading technical teams.

Key Responsibilities

• Design and develop scalable data pipelines using AWS services.
• Build and optimize ETL/ELT workflows.
• Develop Data Lake and Data Warehouse solutions.
• Lead data engineering projects and mentor team members.
• Collaborate with stakeholders to deliver business-driven data solutions.
• Ensure data quality, security, and performance.

Required Skills

• 7–12 years of Data Engineering experience.
• Strong hands-on experience with AWS Glue, S3, Redshift, Athena, EMR, Lambda, IAM, Step Functions, and CloudWatch.
• Strong programming skills in Python and SQL.
• Experience with Apache Airflow/MWAA.
• Knowledge of Data Lakes, Data Warehousing, and data modeling.
• Experience with Git, CI/CD, and Terraform/CloudFormation.
• Experience with Power BI, Tableau, or QuickSight.

Preferred Skills

• Experience with Snowflake or Databricks.
• Exposure to Kafka/Kinesis.
• AWS Certification is an added advantage.

Notice Period: Immediate to 30 Days Preferred.