Staff Platform Engineer - Data Ingestion & Lakehouse

Nagarro; Abu Dhabi; On-site; AED 120,000 - 200,000; Full time

Job summary

A prominent tech company is seeking a skilled individual to manage AWS Glue jobs for data ingestion and optimize performance for a Lakehouse architecture. The role involves developing ETL pipelines, executing historical data loading, and ensuring compliance with data contracts. Strong expertise in AWS Glue, collaboration with teams, and a proficiency in Git and Terraform are essential. This full-time position is based in Abu Dhabi and does not allow for remote work.

Qualifications

• Strong experience in AWS Glue and ETL pipeline development.
• Knowledge of Lakehouse architecture and Medallion design principles.
• Ability to work in a fast-paced environment and meet targets.

Responsibilities

• Build and implement AWS Glue jobs for Bronze layer ingestion.
• Optimize Glue job performance and collaborate with platform teams.
• Migrate source tables to Bronze layer and automate deployments.

Skills

AWS Glue

PySpark

ETL pipeline development

Lakehouse architecture

CDC delta loads

Agile working

Jira

Tools

AWS Services: Glue, S3, Athena, Lambda

Git

Terraform

Job description

A prominent tech company is seeking a skilled individual to manage AWS Glue jobs for data ingestion and optimize performance for a Lakehouse architecture. The role involves developing ETL pipelines, executing historical data loading, and ensuring compliance with data contracts. Strong expertise in AWS Glue, collaboration with teams, and a proficiency in Git and Terraform are essential. This full-time position is based in Abu Dhabi and does not allow for remote work.