Data Engineer

Systems Limited; Dubai; On-site; AED 120,000 - 200,000; Full time

Job summary

A leading tech company in Dubai is seeking an experienced professional in Cloud and Data Engineering. The ideal candidate will work with Azure technologies, building robust ETL/ELT pipelines and managing Docker and Kubernetes for containerization. Experience with big data processing tools such as Apache Spark is essential. The role offers a competitive salary and the opportunity to work in a dynamic environment.

Responsibilities

• Design and implement ETL/ELT pipelines for data processing.
• Work with Azure Data Factory and other cloud technologies.
• Manage containerization and orchestration using Docker and Kubernetes.

Skills

Cloud Engineering

Data Engineering

Big Data Processing

Containerization

Monitoring

Tools

Azure Data Factory

Apache Spark

Docker

Kubernetes

Prometheus

Job description

Responsibilities

• Cloud & Data Engineering: Azure Data Factory, Azure Databricks, Unity Catalog, ADLS, Azure SQL, Azure Cosmos DB AWS (S3, EC2, ALB, NLB, EKS, DynamoDB)
• Big Data & Data Processing: Apache Spark, PySpark, Spark SQL, Kafka, Delta Lake, Batch Processing, Streaming Data
• Data Engineering: ETL/ELT Pipelines, Data Pipelines, Data Migration, Data Modeling, Data Warehousing, Data Quality, Data Integration
• Containerization & Orchestration: Docker, Kubernetes, Helm
• Monitoring & Logging: Prometheus, Grafana, Amazon CloudWatch