Data Platform Engineer

Venquis; Abu Dhabi; On-site; AED 350,000 - 600,000; Full time

Job summary

Venquis is seeking an experienced Lakehouse Platform Engineer in Abu Dhabi to manage and evolve the Lakehouse technology stack, focusing on reliability, governance, and self-service for data teams. You will optimize storage, compute, and catalog layers, drive automated maintenance, and collaborate across platform and operational teams to meet migration and reliability targets.

The role emphasizes deep expertise with AWS Lakehouse stacks, Iceberg, OpenMetadata, Soda Core, and automation using

Qualifications

• Strong experience managing Lakehouse platforms on AWS.
• Proficiency in AWS services: S3, Glue, CloudTrail, Athena.
• Hands-on experience with Apache Iceberg, OpenMetadata, and Soda Core.
• Knowledge of disaster recovery planning and execution.

Responsibilities

• Manage and optimize Lakehouse components on AWS.
• Implement automated table maintenance and governance.
• Deploy self-service tooling for data teams.
• Configure lineage capture from Glue jobs and audit logging.
• Ensure DR scenarios, backups, failover, and runbooks are in place.
• Collaborate with platform engineers and data teams to improve tooling.

Skills

Lakehouse on AWS

AWS S3

Iceberg

OpenMetadata

Soda Core

Terraform

Git

Kafka (MSK)

OpenSearch

Disaster recovery

Automation

Tools

Terraform

Git

Kafka (MSK)

OpenSearch

Iceberg

OpenMetadata

Soda Core

AWS Glue

Job description

Role: AWS Lakehouse Platform Engineer

Location: Abu Dhabi
Employment Type: Full-time

Overview

We are seeking a Lakehouse Platform Engineer to manage, optimize, and evolve the entire Lakehouse technology stack, ensuring platform reliability, scalability, and compliance with governance standards. This role is critical for maintaining the backbone of our data ecosystem and enabling self-service capabilities for data teams.

Key Responsibilities

• Platform Management & Optimization
  • Manage and maintain Lakehouse components:
  • Storage: S3 bucket configurations, lifecycle policies, storage optimization.
  • Compute: AWS Glue job management, optimization, DPU allocation.
  • Catalog: AWS Glue Data Catalog and Iceberg table registry.
  • Semantic Layer: Deploy and integrate with our semantic layer.
  • Governance: Deploy, configure, and upgrade OpenMetadata.
  • Quality: Maintain Soda Core infrastructure and integration.
  • Apply Iceberg best practices for table optimization and maintenance.
  • Implement automated table maintenance processes.
• Self-Service & Automation
  • Deploy self-service tooling for Data Factory squads.
  • Implement automated lineage capture from Glue jobs.
  • Configure audit logging (CloudTrail, S3 access logs).
• Disaster Recovery & Reliability
  • Design and implement Disaster Recovery (DR) scenarios including failover, backup management, and runbooks.
  • Execute annual DR tests for the entire data landscape.
  • Ensure all critical platform components are monitored, with alerting and active follow-up.
• Migration & Decommissioning
  • Execute decommissioning roadmap.
• Collaboration
  • Work closely with platform engineers and architects to ensure alignment on optimization and tooling.
  • Partner with operational teams for monitoring and alerting.

Required Skills & Experience

• Technical Expertise
  • Strong experience managing Lakehouse platforms on AWS.
  • Proficiency in AWS services: S3, Glue, CloudTrail, Athena.
  • Hands‑on experience with Apache Iceberg, OpenMetadata, and Soda Core.
  • Knowledge of disaster recovery planning and execution.
• Tools & Technologies
  • Infrastructure automation using Terraform and Git.
  • Familiarity with Kafka (MSK) and OpenSearch.
  • Able to identify ways to automate their work / repetitive tasks.
• Soft Skills
  • Strong problem‑solving and troubleshooting skills.
  • Ability to work cross‑functionally and manage complex platform operations.
  • Ability to work in a fast‑paced environment and deliver aggressive migration targets.
  • Strong collaboration and communication skills.
  • Work with Jira and agile way of working.

Preferred Qualifications

• 8+ years in data platform engineering or related roles.
• Experience in financial services or banking domain is a plus.