AWS Data Engineer

Salt; Abu Dhabi; On-site; AED 480,000 - 720,000; Full time

Job summary

Salt is seeking a senior Data Engineer to design and implement scalable AWS-based ingestion pipelines in Abu Dhabi. You will work on Glue, S3, Athena, and Lambda, applying CDC, delta loads, and historical migrations to deliver robust data flows.

You will optimize performance, adhere to data contracts, and collaborate with Data Architects, Data Assurance, and Platform teams to automate repetitive tasks. This six-month contract could extend based on performance.

Qualifications

• 5+ years of experience in Data Engineering.
• Strong hands-on experience with AWS data services, particularly Glue, S3, Athena, and Lambda.
• Strong PySpark and ETL/ELT development experience.
• Good understanding of Lakehouse architecture and Medallion design principles.
• Experience with CDC, batch ingestion, delta loads, and historical data migration.
• Experience with Git, Terraform, CI/CD, and Agile/Jira.
• Banking or financial services experience is an advantage.

Responsibilities

• Build and maintain data ingestion pipelines using AWS Glue, PySpark, S3, Athena, and Lambda.
• Implement CDC, full load, delta, snapshot, and historical loading patterns.
• Develop and optimize Bronze-layer ingestion pipelines.
• Improve pipeline performance through partitioning, parallelization, and AWS best practices.
• Automate deployment and infrastructure using Git and Terraform.
• Ensure pipelines comply with data contracts, monitoring, and data quality standards.
• Work closely with Data Architects, Data Assurance, and Platform teams.
• Identify opportunities to automate repetitive migration and engineering activities.

Skills

Data ingestion

PySpark

ETL/ELT development

Agile/Jira

Performance optimization

Tools

AWS Glue

AWS S3

AWS Athena

AWS Lambda

Git

Terraform

Job description

Contract Length – 6 Months (view to extend)
Start Date – ASAP
The role will focus on building scalable AWS-based ingestion pipelines, optimizing performance, and ensuring alignment with architecture and data quality standards.

Key Responsibilities:

• Build and maintain data ingestion pipelines using AWS Glue, PySpark, S3, Athena, and Lambda.
• Implement CDC, full load, delta, snapshot, and historical loading patterns.
• Develop and optimize Bronze-layer ingestion pipelines.
• Improve pipeline performance through partitioning, parallelization, and AWS best practices.
• Automate deployment and infrastructure using Git and Terraform.
• Ensure pipelines comply with data contracts, monitoring, and data quality standards.
• Work closely with Data Architects, Data Assurance, and Platform teams.
• Identify opportunities to automate repetitive migration and engineering activities.

Required Skills & Experience:

• 5+ years of experience in Data Engineering.
• Strong hands-on experience with AWS data services, particularly Glue, S3, Athena, and Lambda.
• Strong PySpark and ETL/ELT development experience.
• Good understanding of Lakehouse architecture and Medallion design principles.
• Experience with CDC, batch ingestion, delta loads, and historical data migration.
• Experience with Git, Terraform, CI/CD, and Agile/Jira.
• Banking or financial services experience is an advantage.