Solution Architect

Antons Recruitment Agency; Dubai; On-site; AED 440,000 - 551,000; Full time

Job summary

A leading recruitment firm is seeking a highly experienced Solutions Architect specializing in Data Engineering and Analytics. The ideal candidate will design and build scalable cloud-based data platforms, utilizing expertise in Azure and Databricks. Responsibilities include leading Data Lakehouse architecture design and optimizing data engineering solutions. A minimum of 12 years of experience in the field, strong communication skills, and technical leadership are essential for this role.

Qualifications

• 12 years in Data Engineering & Analytics with a focus on cloud-based platforms.
• Proven expertise in Azure Cloud Services and Lakehouse architectures.
• Hands-on experience building large-scale data pipelines.

Responsibilities

• Lead the design and implementation of Data Lakehouse architectures.
• Build and optimize scalable data engineering solutions using Azure.
• Drive adoption and implementation of data governance schema.

Skills

Data Engineering

Azure

Databricks

PySpark

Scala

SQL

Data Governance

Cloud Cost Optimization

Stakeholder Management

Tools

Azure Data Factory

Delta Lake

Unity Catalog

Azure Event Hub

Job description

We are seeking a highly experienced Solutions Architect specializing in Data Engineering and Analytics to design, build and deploy scalable cloud-based data platforms. The ideal candidate will have deep expertise in Azure and Databricks, strong architectural knowledge of Data Lakehouse solutions and a proven ability to guide teams in implementing enterprise-grade data platforms.

Key Responsibilities

• Architect & Design: Lead the design and implementation of Data Lakehouse architectures including batch and real-time streaming pipelines using Delta Lake.

• Cloud Data Platforms: Build and optimize scalable data engineering solutions leveraging Azure Data Factory Databricks ADLS Azure Event Hub PySpark/Scala/SQL.

• Data Governance & Cataloging: Drive the adoption and implementation of Unity Catalog ensuring robust data lineage governance schema and access control mechanisms.

• Performance & Cost Optimization: Review solutions and guide teams on performance tuning cloud cost optimization and architectural best practices.

• Technical Leadership: Act as a trusted advisor to engineering teams providing hands-on guidance in data engineering analytics and cloud-native design patterns.

• Innovation & Strategy: Evaluate new tools frameworks and approaches to continuously improve the enterprise data ecosystem.

Key Skills & Experience

• 12 years in Data Engineering & Analytics with strong focus on cloud-based platforms.

• Proven expertise in Azure Cloud Services Databricks Delta Lake and Lakehouse architectures.

• Hands-on experience with PySpark Scala and SQL for building large-scale data pipelines.

• Strong knowledge of data governance security frameworks and data cataloging tools (Unity Catalog preferred).

• Experience with streaming technologies (Azure Event Hub Kafka or similar).

• Strong understanding of data pipeline frameworks distributed computing and performance optimization.

• Excellent communication leadership and stakeholder management skills.