Senior Data Engineer - Banking Lakehouse on AWS

VaporVM

Dubai

On-site

AED 300,000 - 520,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

VaporVM in the UAE seeks an experienced Data Engineer to design, build, and optimise scalable Lakehouse data architectures on AWS using Databricks and Delta Lake. The role focuses on enterprise analytics and ML readiness within banking data environments, ensuring governance and robust security.

You will develop batch and real-time pipelines with PySpark, Python, SQL, and Kafka, while collaborating with data science and MLOps teams to productionise models on SageMaker and maintain strong data

Qualifications

  • Experience in data engineering within banking, financial services, or fintech environments.
  • Strong understanding of financial datasets, transactional systems, and banking data governance and regulatory requirements.
  • Extensive hands-on experience with AWS data services, particularly S3, Glue, EMR, and Redshift.
  • Strong experience with Apache Spark, PySpark, and Apache Kafka for large-scale data processing.
  • Demonstrated experience designing and implementing Lakehouse architectures using Databricks and Delta Lake.
  • Solid understanding of data modelling, schema evolution, ACID transactions, and data warehousing principles.
  • Proficiency in Python and SQL. Experience with Scala is an advantage.
  • Practical experience with Docker, Kubernetes (EKS), Terraform, and Git-based workflows.
  • Strong analytical and problem-solving skills.
  • Excellent communication and stakeholder management skills, with the ability to explain technical concepts to both technical and non-technical audiences.

Responsibilities

  • Design, develop, and maintain scalable Lakehouse architectures using Databricks and Delta Lake on AWS.
  • Build and optimise batch and real-time ETL/ELT pipelines using Python, PySpark, SQL, and Apache Kafka to process financial and transactional data.
  • Develop data solutions using AWS services, including S3, Glue, EMR, Redshift, and Athena.
  • Improve data processing performance and storage efficiency via partitioning, indexing, and distributed processing.
  • Collaborate with data science and MLOps teams to build feature engineering pipelines, manage experiments using MLflow, and support model deployment through AWS SageMaker.
  • Implement data governance, access controls, encryption, monitoring, and auditing per banking regulations.
  • Apply IaC using Terraform and manage CI/CD with GitHub Actions or CodePipeline.
  • Write clean, tested Python code and use version control best practices.
  • Engage with client stakeholders and cross-functional teams to translate requirements into architecture.

Skills

Python
SQL
PySpark
Kafka
Databricks
Delta Lake
Spark
Docker
Kubernetes
Terraform
Git
Airflow
Prefect
SageMaker

Tools

AWS S3
AWS Glue
AWS EMR
AWS Redshift
AWS Athena
Databricks
MLflow
Airflow
Docker
Kubernetes
Terraform
GitHub Actions
CodePipeline

Job description

VaporVM in the UAE seeks an experienced Data Engineer to design, build, and optimise scalable Lakehouse data architectures on AWS using Databricks and Delta Lake. The role focuses on enterprise analytics and ML readiness within banking data environments, ensuring governance and robust security.

You will develop batch and real-time pipelines with PySpark, Python, SQL, and Kafka, while collaborating with data science and MLOps teams to productionise models on SageMaker and maintain strong data

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer, AWS Lakehouse for Banking Analytics
Data Engineer, AWS Lakehouse for Banking Analytics

Deeplight • Abu Dhabi

On-site
AED 240,000 - 420,000
Gold level health insurance
Individual visa sponsorship
Professional development support
+4
Lakehouse Data Engineer - AWS & Banking Analytics
Lakehouse Data Engineer - AWS & Banking Analytics

Deeplight • Dubai

On-site
AED 350,000 - 600,000
Competitive salary
Gold Level health insurance
Individual Visa Sponsorship
+5
Data Engineer
Data Engineer

VaporVM • Dubai

On-site
AED 300,000 - 520,000
Data Engineer — Lakehouse, MLOps & Banking-Grade Security
Data Engineer — Lakehouse, MLOps & Banking-Grade Security

Deeplight AI • Dubai

Hybrid
AED 180,000 - 260,000
Salary
Health insurance
Visa sponsorship
+5
AWS Data Platform Engineer – Pipelines, Lakehouse & Governance
AWS Data Platform Engineer – Pipelines, Lakehouse & Governance

Dicetek LLC • Abu Dhabi

On-site
AED 280,000 - 420,000
Senior Databricks Lakehouse Engineer - AI/BI Pipelines
Senior Databricks Lakehouse Engineer - AI/BI Pipelines

NR Consulting • Abu Dhabi

On-site
AED 300,000 - 520,000
Lead Data Architect: Banking-Grade Lakehouse & AI Platform
Lead Data Architect: Banking-Grade Lakehouse & AI Platform

Deeplight AI • Abu Dhabi

On-site
AED 380,000 - 650,000
Health insurance
Visa sponsorship
Professional development support
+2
Senior Investment Data Engineer (Databricks Lakehouse)
Senior Investment Data Engineer (Databricks Lakehouse)

Luxoft • Abu Dhabi

On-site
AED 391,000 - 614,000
Cloud Data Engineer — Databricks, Azure & Kafka
Cloud Data Engineer — Databricks, Azure & Kafka

Dicetek • Abu Dhabi

On-site
AED 260,000 - 380,000
Remote Senior Data Engineer - Cloud Analytics & Lakehouse
Remote Senior Data Engineer - Cloud Analytics & Lakehouse

Taraki • Dubai

Remote
AED 300,000 - 520,000
Top locations