AWS Glue Developer

Elabs Infotech; Pune District; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Elabs Infotech is seeking an experienced AWS Glue Developer / Databricks Data Engineer with 8-12 years of hands-on experience in designing and implementing scalable data pipelines on cloud platforms.

The ideal candidate will excel in PySpark, Python, SQL, S3 and AWS data services, building ETL/ELT workflows, optimizing performance, and contributing to data warehousing and modeling initiatives in a large-scale environment.

Qualifications

• 8+ years of experience in Data Engineering, with strong experience in cloud data platforms.
• Strong hands-on experience with AWS Glue.
• Strong experience with Databricks and Apache Spark.
• Excellent proficiency in PySpark and Python.
• Strong SQL skills with experience in complex queries and query optimization.
• Hands-on experience with Amazon S3 and AWS data services.
• Experience designing and implementing ETL/ELT data pipelines.
• Strong understanding of distributed data processing and Spark architecture.
• Experience working with large-scale datasets and performance optimization.
• Good understanding of data warehousing, data modeling, and data integration concepts.
• Experience with production support, troubleshooting, and performance tuning.

Skills

Data engineering

AWS Glue

Databricks

Apache Spark

PySpark

Python

SQL

ETL/ELT pipelines

Big data

Data warehousing concepts

Tools

Amazon S3

AWS data services

Job description

We are looking for an experienced AWS Glue Developer / Databricks Data Engineer with 8-12 years of experience in designing, developing, and implementing scalable data engineering solutions. The ideal candidate should have strong hands-on expertise in AWS Glue and Databricks, along with solid experience in building ETL/ELT pipelines, data transformations, and cloud-based data platforms.

Required Skills & Experience:

• 8+ years of experience in Data Engineering, with strong experience in cloud data platforms.
• Strong hands-on experience with AWS Glue.
• Strong experience with Databricks and Apache Spark.
• Excellent proficiency in PySpark and Python.
• Strong SQL skills with experience in complex queries and query optimization.
• Hands-on experience with Amazon S3 and AWS data services.
• Experience designing and implementing ETL/ELT data pipelines.
• Strong understanding of distributed data processing and Spark architecture.
• Experience working with large-scale datasets and performance optimization.
• Good understanding of data warehousing, data modeling, and data integration concepts.
• Experience with production support, troubleshooting, and performance tuning.