Azure Data Engineer — Build Scalable Data Pipelines

Datamaze.ai; Dubai; On-site; AED 250,000 - 420,000; Full time

Job summary

Datamaze.ai in Dubai invites a skilled Data Engineer to design, build and scale data pipelines on Azure. You will integrate data from diverse sources using Azure Data Factory, Databricks and Synapse, and develop robust data models to support analytics.

You will optimize pipelines for performance and cost, manage Azure databases, implement ETL/ELT processes, and collaborate with analysts and business teams while adhering to security and governance policies.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, IT, or related field (or equivalent experience).
• 3–5 years of experience in data engineering or a similar role.
• Experience with large datasets and cloud-based data solutions.
• Strong SQL and programming skills with Python/Scala/Java.

Responsibilities

• Data Pipeline Development: Design build and maintain robust scalable data pipelines using Azure Data Factory Databricks and other Azure services.
• Data Integration: Integrate structured and unstructured data from diverse sources into Azure-based data platforms.
• Data Modeling: Develop and maintain data models to support analytical and reporting requirements.
• Optimization: Monitor and optimize data pipelines for performance scalability and cost-efficiency.
• Database Management: Administer and manage Azure Synapse Analytics Azure SQL Database and other database solutions.
• ETL Processes: Design and implement Extract Transform Load ETL processes to transform raw data into actionable insights.
• Collaboration: Work closely with data analysts business teams and other stakeholders to understand data needs and deliver effective solutions.
• Security and Compliance: Ensure data solutions align with organizational security policies and industry regulations.
• Documentation: Create and maintain comprehensive documentation for data workflows architectures and processes.

Skills

SQL proficiency

ETL/ELT

Data integration

Data modeling

Security governance

Python

Scala

Java

Power BI

RBAC

Team collaboration

Problem solving

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Data Factory

Azure Synapse Analytics

Azure Databricks

Azure Storage

Spark

Hadoop

Cosmos DB

MongoDB

Python

Scala

Java

Power BI

Job description

Datamaze.ai in Dubai invites a skilled Data Engineer to design, build and scale data pipelines on Azure. You will integrate data from diverse sources using Azure Data Factory, Databricks and Synapse, and develop robust data models to support analytics.

You will optimize pipelines for performance and cost, manage Azure databases, implement ETL/ELT processes, and collaborate with analysts and business teams while adhering to security and governance policies.