Lakehouse Ingestion Engineer - AWS Glue & PySpark

Deeplight; Dubai; On-site; AED 120,000 - 200,000; Full time

Job summary

A leading AI consultancy in Dubai is seeking a skilled AWS Glue Data Engineer to join the Data Factory Squad. You will focus on building scalable ingestion pipelines, optimizing performance, and ensuring compliance with architectural standards. The ideal candidate will have over 5 years of experience in data engineering, particularly in AWS Glue and ETL pipeline development, along with a passion for leveraging data solutions to enhance business operations.

Benefits

Competitive salary and performance bonuses

Comprehensive health insurance

Professional development and certification support

Flexible working arrangements

Career advancement opportunities

Qualifications

• Experience with AWS Glue and ETL pipeline development.
• Knowledge of Lakehouse architecture and Medallion design principles.
• Ability to work in a fast-paced environment.

Responsibilities

• Develop AWS Glue jobs for data ingestion.
• Optimize Glue job performance based on best practices.
• Migrate source tables to Bronze layer efficiently.

Skills

AWS Glue

PySpark

ETL pipeline development

Data quality frameworks

Git

Terraform for CI/CD automation

Collaboration

Education

5+ years in data engineering

Tools

AWS services: Glue, S3, Athena, Lambda

Jira

Job description

A leading AI consultancy in Dubai is seeking a skilled AWS Glue Data Engineer to join the Data Factory Squad. You will focus on building scalable ingestion pipelines, optimizing performance, and ensuring compliance with architectural standards. The ideal candidate will have over 5 years of experience in data engineering, particularly in AWS Glue and ETL pipeline development, along with a passion for leveraging data solutions to enhance business operations.