Solution Architect

Antons Recruitment Agency; Dubai; On-site; AED 200,000 - 300,000; Full time

Job summary

A prominent recruitment agency is seeking an experienced Solutions Architect specializing in Data Engineering and Analytics. The role involves designing, implementing, and optimizing scalable cloud-based data platforms using Azure and Databricks. Candidates should have over 12 years of experience with a focus on data pipeline frameworks and governance. Strong communication and leadership skills are essential. The position is based in Dubai, United Arab Emirates and offers a dynamic working environment.

Qualifications

• 12+ years of experience in Data Engineering & Analytics focusing on cloud-based platforms.
• Proven expertise in Azure Cloud Services and Lakehouse architectures.
• Hands-on experience with PySpark, Scala, and SQL for data pipelines.

Responsibilities

• Lead design and implementation of Data Lakehouse architectures.
• Build scalable data engineering solutions using Azure tools.
• Drive the implementation of Unity Catalog for data governance.

Skills

Data Engineering

Analytics

Azure

Databricks

Delta Lake

PySpark

Scala

SQL

Data Governance

Tools

Azure Data Factory

ADLS

Azure Event Hub

Kafka

Job description

We are seeking a highly experienced Solutions Architect specializing in Data Engineering and Analytics to design, build, and deploy scalable cloud-based data platforms. The ideal candidate will have deep expertise in Azure and Databricks, strong architectural knowledge of Data Lakehouse solutions, and a proven ability to guide teams in implementing enterprise-grade data platforms.

Key Responsibilities

Architect & Design: Lead the design and implementation of Data Lakehouse architectures, including batch and real-time streaming pipelines using Delta Lake.

Cloud Data Platforms: Build and optimize scalable data engineering solutions leveraging Azure Data Factory, Databricks, ADLS, Azure Event Hub, PySpark/Scala/SQL.

Data Governance & Cataloging: Drive the adoption and implementation of Unity Catalog, ensuring robust data lineage, governance, schema, and access control mechanisms.

Performance & Cost Optimization: Review solutions and guide teams on performance tuning, cloud cost optimization, and architectural best practices.

Technical Leadership: Act as a trusted advisor to engineering teams, providing hands-on guidance in data engineering, analytics, and cloud-native design patterns.

Innovation & Strategy: Evaluate new tools, frameworks, and approaches to continuously improve the enterprise data ecosystem.

Key Skills & Experience

12+ years in Data Engineering & Analytics with strong focus on cloud-based platforms.

Proven expertise in Azure Cloud Services, Databricks, Delta Lake, and Lakehouse architectures.

Hands-on experience with PySpark, Scala, and SQL for building large-scale data pipelines.

Strong knowledge of data governance, security frameworks, and data cataloging tools (Unity Catalog preferred).

Experience with streaming technologies (Azure Event Hub, Kafka, or similar).

Strong understanding of data pipeline frameworks, distributed computing, and performance optimization.

Excellent communication, leadership, and stakeholder management skills.