Databricks Engineer: Finance Data Pipelines (Remote/Dubai)

Qrusible Talent Network; Dubai; Hybrid; AED 180,000 - 260,000; Full time

Job summary

Pinnacle DXB, a Dubai-based IT solutions firm, seeks a Databricks Specialist to design and run data pipelines for a Finance Automation Program. You will ingest ERP and finance data, structure bronze/silver/gold layers, and deliver reliable datasets for Power BI, AI agents, and web apps.

Onsite in Dubai or remote, full-time; 4–7 years in data engineering with Databricks required. Strong PySpark/SQL, Delta Lake, Unity Catalog and production experience with Databricks Workflows are essential.

Qualifications

• 4–7 years in data engineering with at least 2 years hands-on Databricks.
• Strong PySpark and SQL proficiency.
• Experience with Delta Lake, Unity Catalog and Databricks Workflows in production.
• Cloud experience with at least one provider (Azure preferred).
• Data modelling and ETL/ELT design across ERP/finance data (AP/AR/GL) preferred.

Responsibilities

• Design, build and maintain batch and incremental pipelines on Databricks.
• Ingest data from ERP, databases, files, APIs and other finance systems.
• Organise data in bronze / silver / gold layers with Delta Lake.
• Write efficient PySpark and SQL transformations.
• Build data quality checks, monitoring, alerts and error handling into pipelines.
• Set up access control and governance with Unity Catalog.
• Orchestrate with Databricks Workflows or Azure Data Factory; tune performance and compute cost.
• Prepare curated datasets for reporting, Power BI, AI agents and the web application; use Git and CI/CD.

Skills

PySpark

SQL

Delta Lake

Unity Catalog

Databricks Workflows

Git

CI/CD

Azure

Data modelling

ERP/finance data

Job description

Pinnacle DXB, a Dubai-based IT solutions firm, seeks a Databricks Specialist to design and run data pipelines for a Finance Automation Program. You will ingest ERP and finance data, structure bronze/silver/gold layers, and deliver reliable datasets for Power BI, AI agents, and web apps.

Onsite in Dubai or remote, full-time; 4–7 years in data engineering with Databricks required. Strong PySpark/SQL, Delta Lake, Unity Catalog and production experience with Databricks Workflows are essential.