Senior Data Engineer (Databricks) – Hands-On Platform Lead

Confidential; Abu Dhabi; On-site; AED 260,000 - 360,000; Full time

Job summary

Confidential is seeking a senior, hands-on Data Engineer to build and scale a modern data platform while directly contributing to implementation. The role balances technical leadership with hands-on delivery and requires staying close to the code and pipelines.

You will mentor engineers, establish engineering standards, review code, and collaborate with architects, analytics and AI teams to drive reliable, scalable data solutions across multi-source environments.

Qualifications

• 8–10+ years of experience in data engineering.
• Hands-on Databricks implementation experience.
• Proficient in Python, SQL and Spark.
• Experience designing scalable ETL/ELT pipelines.
• Experience with data warehouses, lakehouses and data marts.
• Knowledge of metadata‑driven ingestion frameworks.
• Production engineering practices: monitoring, testing, reliability.
• Data governance, metadata, lineage, security.
• Batch and real-time processing experience.
• Cloud platform experience, preferably Azure.

Responsibilities

• Build and scale a modern data platform.
• Provide technical leadership to the engineering team.
• Mentor engineers and set delivery standards.
• Hands-on implementation and code reviews.
• Collaborate with architects, analytics, AI teams and stakeholders.

Skills

Databricks

Python

SQL

Spark

ETL pipelines

Data warehouses

Lakehouse

Mentoring

Data governance

Real-time processing

Production engineering

Stakeholder comms

Tools

Databricks

Azure

Job description

Confidential is seeking a senior, hands-on Data Engineer to build and scale a modern data platform while directly contributing to implementation. The role balances technical leadership with hands-on delivery and requires staying close to the code and pipelines.

You will mentor engineers, establish engineering standards, review code, and collaborate with architects, analytics and AI teams to drive reliable, scalable data solutions across multi-source environments.