Senior Databricks Data Engineer and Cloud Lakehouse Expert

Flentas; Dubai; On-site; AED 420,000 - 660,000; Full time

Job summary

Flentas is seeking a senior Data Engineer to design and optimize scalable data platforms and pipelines. You will work on data ingestion, transformation, and governance across cloud-native environments using Python, PySpark, and Databricks.

The role emphasizes building Lakehouse architectures, data lakes/warehouses, and collaborating with data scientists and analysts to deliver enterprise-grade solutions.

Qualifications

• 7-10 years in Data Engineering, Big Data, or Cloud Data Platforms.
• Strong Python programming.
• Hands-on PySpark and Apache Spark experience.
• Extensive Databricks, Delta Lake, and Lakehouse architecture know-how.
• Strong SQL and DB performance optimization.
• Experience building enterprise-scale ETL/ELT pipelines.
• Hands-on AWS Cloud Platform & cloud-native data solutions.
• Data modeling and data warehousing concepts.
• Familiar with data workflows using Airflow or equivalents.
• Solid software engineering basics, version control and testing.

Responsibilities

• Design, develop, and maintain scalable batch and real-time data pipelines.
• Build data ingestion frameworks for structured, semi-structured, and unstructured data.
• Develop and optimize data transformation workflows with Python, PySpark, and Databricks.
• Implement and manage ETL/ELT processes for large-scale analytics.
• Design and maintain Data Lakes, Lakehouse architectures, and Data Warehouses.
• Collaborate with Data Scientists, Analysts, Architects and stakeholders to translate requirements.
• Ensure data quality, integrity, security, and governance across platforms.
• Optimize Spark jobs, SQL queries, and cloud resources for performance and cost.
• Implement monitoring, logging, and alerting for data pipelines.
• Contribute to architecture discussions, code reviews, and best practices.

Skills

Python

PySpark

Databricks

AWS Cloud Platform

SQL

Apache Spark

Airflow

Data modeling

Lakehouse

Tools

Apache Airflow

Databricks

Delta Lake

Apache Spark

Job description

Flentas is seeking a senior Data Engineer to design and optimize scalable data platforms and pipelines. You will work on data ingestion, transformation, and governance across cloud-native environments using Python, PySpark, and Databricks.

The role emphasizes building Lakehouse architectures, data lakes/warehouses, and collaborating with data scientists and analysts to deliver enterprise-grade solutions.