Data Engineer: Real-Time Pipelines & Cloud AI Integration

Artefact; Dubai; On-site; AED 60,000 - 80,000; Full time

Job summary

A data service provider in Dubai is seeking a Data Engineer to craft and maintain robust data pipelines using Python and SQL. Responsibilities include data pipeline development, database management, and leveraging cloud services like MS Azure and GCP. The ideal candidate should have excellent problem-solving skills, strong communication abilities, and a degree in Computer Science or a related field. This role offers an opportunity to work in a dynamic environment, integrating machine learning models and utilizing technologies like Spark and Kafka.

Qualifications

• Proficiency in Python, SQL, and database management.
• Experience with Data Pipelines, ETL, Cloud Services (MS Azure, GCP preferred).
• Proven problem-solving skills and a solution-oriented mindset.
• Excellent communication skills to collaborate effectively.
• Strong business acumen with interest in business-facing roles.
• Adaptability to thrive in a dynamic environment.

Responsibilities

• Building and optimising data pipelines for seamless data flow.
• Managing databases and ensuring data integrity.
• Leveraging cloud services for scalable data solutions.
• Collaborating to integrate machine learning models.
• Implementing Spark and Kafka for real-time processing.

Skills

Python

SQL

Database Management

ETL

Cloud Services

Machine Learning

Spark

Kafka

Education

Computer Science degree

Electronics Engineering degree

Communication Engineering degree

Job description

A data service provider in Dubai is seeking a Data Engineer to craft and maintain robust data pipelines using Python and SQL. Responsibilities include data pipeline development, database management, and leveraging cloud services like MS Azure and GCP. The ideal candidate should have excellent problem-solving skills, strong communication abilities, and a degree in Computer Science or a related field. This role offers an opportunity to work in a dynamic environment, integrating machine learning models and utilizing technologies like Spark and Kafka.