Data Engineer

Artefact; Dubai; On-site; AED 60,000 - 80,000; Full time

Job summary

A data service provider in Dubai is seeking a Data Engineer to craft and maintain robust data pipelines using Python and SQL. Responsibilities include data pipeline development, database management, and leveraging cloud services like MS Azure and GCP. The ideal candidate should have excellent problem-solving skills, strong communication abilities, and a degree in Computer Science or a related field. This role offers an opportunity to work in a dynamic environment, integrating machine learning models and utilizing technologies like Spark and Kafka.

Qualifications

• Proficiency in Python, SQL, and database management.
• Experience with Data Pipelines, ETL, Cloud Services (MS Azure, GCP preferred).
• Proven problem-solving skills and a solution-oriented mindset.
• Excellent communication skills to collaborate effectively.
• Strong business acumen with interest in business-facing roles.
• Adaptability to thrive in a dynamic environment.

Responsibilities

• Building and optimising data pipelines for seamless data flow.
• Managing databases and ensuring data integrity.
• Leveraging cloud services for scalable data solutions.
• Collaborating to integrate machine learning models.
• Implementing Spark and Kafka for real-time processing.

Skills

Python

SQL

Database Management

ETL

Cloud Services

Machine Learning

Spark

Kafka

Education

Computer Science degree

Electronics Engineering degree

Communication Engineering degree

Job description

Artefact is a new generation of data service providers specialising in data consulting and datadriven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say were enjoying skyrocketing growth.

The backbone of our consulting missions today our Data consulting team has more than 400 consultants covering all Artefacts offers (and more): data marketing data governance strategy consulting product owner

What you will be doing

As a Data Engineer your role involves crafting and maintaining robust data pipelines utilising Python and SQL to ensure efficient extraction transformation and loading (ETL) of data.

Your responsibilities will include:

• Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms.
• Database Management: Managing databases ensuring their integrity and implementing data storage and retrieval solutions.
• Cloud Services Integration: Leveraging cloud services such as MS Azure GCP and AWS to architect and deploy scalable data solutions.
• Machine Learning Integration: Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing.
• Utilising Spark & Kafka: Implementing and working with Spark and Kafka for realtime data processing and analytics.

What we are looking for

• Proficiency in Python SQL and database management.
• Experience with Data Pipelines ETL Cloud Services MS Azure GCP preferred).
• Proven problemsolving skills and a solutionoriented mindset.
• Excellent communication skills to collaborate effectively within teams and with stakeholders.
• Strong business acumen with an interest in businessfacing roles.
• Adaptability and a startup mentality to thrive in a dynamic environment.
• Candidates with similar skill sets and experiences have excelled in technology firms or consultancy firms.
• Successful candidates often possess Computer Science Electronics and Communication Engineering degrees.