Azure DevOps Engineer (m/f/d)

SupportFinity™; Abu Dhabi; On-site; AED 220,000 - 360,000; Full time

Job summary

Halian | Managed Services, Recruitment Agency & Contract Staffing is seeking a skilled DevOps Engineer to mature our data platform and developer experience in Abu Dhabi. You will evolve our DevOps platform, automate IaC, and implement governance for secure, scalable data workloads.

Ideal candidates have Azure Databricks admin experience, strong scripting skills, and a background in data engineering or BI collaboration.

Qualifications

• Bachelor’s degree in a relevant field (e.g., Data/Software Engineering, CS).
• Extensive hands-on Azure Cloud and Databricks administration experience.
• IaC experience with Terraform or Bicep and infrastructure versioning.
• Strong experience with CI/CD pipelines for data workloads/infra.
• Proficient scripting in Python, PowerShell or Bash.
• Experience collaborating with data engineering, analytics and BI teams.
• Azure certifications are a plus.

Responsibilities

• Enhance our Databricks Asset Bundles (DABs) and developer experience.
• Develop end-to-end CI/CD pipelines in Azure DevOps for ADF, ADB and PowerBI.
• Automate provisioning of Databricks resources using Terraform or templates.
• Governance: mature security policies and access controls.
• Manage ADF resources for reliability and cost efficiency.
• Improve observability and cost optimization across storage and compute.

Skills

Azure Cloud

Azure Databricks

Terraform

Bicep

CI/CD pipelines

Git

Python

PowerShell

Bash

Spark internals

Cost management

Education

Bachelor's degree in a relevant field

Tools

Azure DevOps

Databricks

Terraform

Bicep

Git

ADF

Power BI

Job description

Halian | Managed Services, Recruitment Agency & Contract Staffing |

Halian | Managed Services, Recruitment Agency & Contract Staffing | Posted Mar 12

Contract

Negotiable

Unknown

We seek a DevOps Engineer to play a pivotal role in maturing our data platform and developer experience. You will be responsible for evolving our DevOps platform, processes and systems with the ultimate aim of enhancing developer velocity and practices, improving code and data quality, and maintaining a well-managed data platform.

Key Responsibilities

• Databricks Asset Bundles (DABs): Enhance our DABs processes to enhance developer experience and velocity.
• CI/CD Pipeline Development: Build end-to-end automation in Azure DevOps to test and promote code across our environments (covering ADF, ADB and PowerBI)
• Infrastructure as Code (IaC): Automate the provisioning of Databricks workspaces clusters, and projects using Terraform or relevant templates.
• Governance: Mature and manage security policies and access controls
• ADF Management: Manage our ADF resources, optimizing for reliability and cost.
• Monitoring & Cost Optimization: Enhance observability across storage and compute to ensure cost effective operations

Educational Background

• Bachelor’s degree in a relevant field (e.g., Data Engineering, Software Engineering, Computer Science)

Professional Experience

• Extensive hands‑on experience with Azure Cloud services; strong understanding of resource provisioning, networking, and security in Azure.
• Deep experience with Azure Databricks administration (clusters, scaling, job scheduling, monitoring).
• Strong experience with IaC (Terraform or Bicep), managing changes via code, and infrastructure versioning.
• Competence with version control (Git) and implementing CI/CD pipelines for data workloads/infra.
• Familiarity with Spark internals (how compute works, resource allocation, partitioning, memory), to aid in optimizing infrastructure.
• Knowledge of cost management on cloud (spot/preemptible VMs, auto-scaling, rightsizing).
• Strong scripting/automation skills (Python / PowerShell / Bash).
• Experience working with data engineering, analytics and BI teams; understanding of pipeline flows, data dependencies, and common data bottlenecks.
• Good to have Databricks or Azure certifications

Location

Azure DevOps Engineer in Abu Dhabi, United Arab Emirates

About the company

Halian | Managed Services, Recruitment Agency & Contract Staffing