Databricks Specialist

Qrusible; Dubai; Hybrid; AED 320,000 - 520,000; Full time

Job summary

Pinnacle DXB is hiring a Databricks Specialist to build and run the data foundation for the Finance Automation Program. You will bring finance data from ERP systems into Databricks, clean and transform it, and prepare reliable datasets for reporting, Power BI, AI agents and web applications.

4–7 years in data engineering with at least 2 years hands-on Databricks is required; onsite in Dubai or remote. The role emphasizes data modeling, ETL/ELT design, governance with Unity Catalog, and

Qualifications

• 4–7 years of data engineering experience.
• At least 2 years hands-on Databricks.
• Strong PySpark and SQL skills.
• Experience with ERP/finance data integration preferred.
• Experience with Delta Lake and Unity Catalog.

Responsibilities

• Design, build and maintain batch and incremental pipelines on Databricks.
• Ingest data from ERP and other finance systems, databases, files and APIs.
• Organise data in bronze/silver/gold layers with Delta Lake.
• Write efficient PySpark and SQL transformations.
• Build data quality checks, monitoring and error handling into pipelines.
• Set up access control and governance with Unity Catalog.
• Orchestrate with Databricks Workflows or Azure Data Factory; tune performance and compute cost.
• Prepare curated datasets for reporting, Power BI, AI agents and web applications.

Skills

PySpark

SQL

Data Modeling

ETL/ELT

Git

CI/CD

Azure

Power BI

Tools

Databricks

Delta Lake

Unity Catalog

Azure Data Factory

Terraform

Job description

Pinnacle DXBpinnacledxb.com# Databricks SpecialistDubai, UAE (onsite) or RemoteFull-time## About the role### Role OverviewThe Databricks Specialist builds and runs the data foundation for Pinnacle DXB's Finance Automation Program. You bring finance data from the ERP and other source systems into Databricks, clean and transform it, and prepare reliable datasets for reporting, Power BI, AI agents and the program's web applications.Experience: 4–7 years in data engineering with at least 2 years hands-on Databricks. Full-time, onsite in Dubai or remote. Finance-domain data experience is strongly preferred. The client wants to close this role within 2–3 weeks.### About Pinnacle DXBPinnacle Computer Systems LLC (Pinnacle DXB) is a Dubai-based IT solutions company founded in 1995, with 30+ years in the region and 2,000+ clients across the Middle East. It delivers ERP and business applications (SAP Business One partner), IT services and support contracts, infrastructure, security, cloud, and Power BI / business-intelligence services to sectors including hospitality, education, healthcare, retail, manufacturing, distribution, contracting, automotive, oil & gas and media. HQ: Office 204, Al Khaleej Building, Al Karama, Dubai, with a presence in Abu Dhabi. Hiring for a Finance Automation Program: dedicated full-time resources, one person per role.### What You'll Work On* Design, build and maintain batch and incremental pipelines on Databricks* Ingest data from the ERP, databases, files, APIs and other finance systems* Organise data in bronze / silver / gold layers with Delta Lake* Write efficient PySpark and SQL transformations* Build data quality checks, monitoring, alerts and error handling into every pipeline* Set up access control and governance with Unity Catalog* Orchestrate with Databricks Workflows or Azure Data Factory; tune performance and compute cost* Prepare curated datasets for reporting, Power BI, AI agents and the web application; use Git and CI/CD### Who Is Right for This Role* 4–7 years in data engineering, including at least 2 years hands-on Databricks* Strong PySpark and SQL* Delta Lake, Unity Catalog and Databricks Workflows in production* At least one cloud (Azure preferred)* Data modelling and ETL/ELT design* Has integrated data from ERP or other enterprise systems; finance data (AP, AR, GL) strongly preferred* Git and basic CI/CD### Good to Have* Delta Live Tables (Lakeflow), Auto Loader, structured streaming* Databricks Asset Bundles, Terraform* SAP data extraction* Power BI* MLflow or Mosaic AI for ML / GenAI use cases* Databricks Certified Data Engineer (Associate or Professional) plus an Azure or AWS data certification### Who Isn't a Fit* Less than 2 years of hands-on Databricks* Only notebook / ad-hoc analysis work, no production pipelines* No experience with enterprise (ERP / finance) source data* Under 4 years of data engineering### How You'll Work* Careful with data accuracy; validates numbers with finance users* Documents data models and pipelines* Works closely with the finance specialist, AI automation and application engineers### Engagement* Full-time, dedicated to the Finance Automation Program (one person per role; openings: 1)* Location: Dubai, UAE (onsite) or Remote* Experience: 4–7 years* Professional English required* ERP and cloud platform to be confirmed by the client (likely SAP / Microsoft Azure; experience with SAP, Oracle or Microsoft Dynamics and Azure or AWS is relevant)* Compensation discussed with shortlisted candidates* Hiring timeline: the client wants to close this role within 2–3 weeks## About the companyCompany name: Pinnacle DXBLogoWebsite: pinnacledxb.comCompany domain: pinnacledxb.comLocation: Dubai, UAE (onsite) or RemoteWork type: Full-time