Data Engineer: AWS Lakehouse & ETL Expert (Abu Dhabi)

DICETEK LLC; Abu Dhabi; On-site; AED 250,000 - 420,000; Full time

Job summary

DICETEK LLC seeks a Senior Data Engineer to design and operate enterprise-grade data pipelines in a secure AWS data lakehouse environment. You will implement ETL/ELT processes, leverage PySpark and SQL, and ensure data quality, governance and scalable architecture within banking/financial services contexts.

The role requires hands-on experience with AWS Glue, Redshift, Athena, Lake Formation, and Iceberg, plus CI/CD and collaboration via Jira/Confluence in an Agile setting.

Qualifications

• Strong hands-on experience delivering enterprise-scale data engineering solutions on AWS.
• Strong development experience with Python/PySpark, SQL and AWS data services.
• Experience designing and developing ETL/ELT and data ingestion pipelines for enterprise systems.
• Experience with Glue Catalog, Redshift, Athena and Lake Formation in data lakehouse environments.
• Understanding of data governance, security, regulatory requirements and IAM controls.

Skills

AWS

Python

PySpark

SQL

Data engineering

Data modeling

Data governance

IAM & security controls

QA & data quality

CI/CD

GitHub Actions

Jira

Confluence

Tools

AWS Glue

Amazon Redshift

Amazon Athena

AWS S3

AWS Lake Formation

Apache Iceberg

APIs

Relational databases

Streaming data sources

GitHub

Jenkins

Job description

DICETEK LLC seeks a Senior Data Engineer to design and operate enterprise-grade data pipelines in a secure AWS data lakehouse environment. You will implement ETL/ELT processes, leverage PySpark and SQL, and ensure data quality, governance and scalable architecture within banking/financial services contexts.

The role requires hands-on experience with AWS Glue, Redshift, Athena, Lake Formation, and Iceberg, plus CI/CD and collaboration via Jira/Confluence in an Agile setting.