Lead Data Engineer

Emirates Global Aluminium (EGA); Dubai; On-site; AED 60,000 - 100,000; Full time

Job summary

An established industry player seeks a Lead Data Engineer to join a dynamic Agile team. This role involves designing and optimizing data pipelines, solving complex data challenges, and developing data products that enhance analytics capabilities. The ideal candidate will have a strong background in data engineering, with proficiency in SQL and programming languages like Python and R. You'll lead initiatives that drive data-driven decision-making and mentor fellow professionals in best practices. If you're passionate about data and eager to make an impact, this opportunity is perfect for you.

Qualifications

• 5+ years in data engineering or architecture with a strong focus on SQL and programming.
• Experience with cloud computing solutions and BI tools for data analytics.

Responsibilities

• Design and maintain data architecture and pipelines for analytics.
• Mentor other data professionals and foster a culture of data sharing.

Skills

SQL

Python

Data Analysis

R

Scala

ETL Tools

Agile Methodologies

Problem Solving

Communication Skills

Education

Bachelor's or MS in Computer Science

Degree in MIS or Engineering

Tools

Tableau

Power BI

Hadoop

BigQuery

Spark

Kafka

Job description

A Lead Data Engineer works closely with a multidisciplinary Agile team to build high-quality data pipelines that drive analytic solutions. These solutions generate insights to enhance data-driven decision-making capabilities. The role requires a deep understanding of data architecture, engineering, analysis, reporting, and a basic knowledge of data science techniques and workflows. The ideal candidate is a skilled data/software engineer with experience in creating data products supporting analytics, working within a technical, cross-functional team.

KEY ACCOUNTABILITIES:

1. Design, develop, optimize, and maintain data architecture and pipelines adhering to ETL principles and business goals.
2. Solve complex data problems to deliver actionable insights.
3. Create data products for analytics and data science teams to improve productivity.
4. Advise, mentor, and coach other data and analytics professionals on data standards and practices.
5. Foster a culture of sharing, re-use, scalability, stability, and operational efficiency of data solutions.
6. Lead evaluation, implementation, and deployment of emerging tools and processes for analytic data engineering.
7. Develop and deliver communication and education plans on data engineering standards and processes.
8. Partner with business analysts and architects to develop technical architectures for strategic projects.
9. Contribute to data science courses as part of advanced analytics and digital academy.
10. Perform other duties as assigned.

QUALIFICATIONS & SKILLS:

Minimum Qualifications:

• Bachelor’s or MS degree; preferred in Computer Science, MIS, or Engineering.
• At least 5 years of experience in data engineering or architecture; 7+ years preferred.
• Expertise in SQL, data analysis, and programming languages such as Python, R, or Scala.

Minimum Experience:

• Experience developing and maintaining data warehouses in big data environments.
• Domain knowledge in metal and mining, energy, heavy industry, or oil and gas sectors.
• Proficiency in programming languages and developing analytics models.
• Experience with dashboard development and BI tools like Tableau, Power BI, etc.
• Experience with cloud computing solutions for data and analytics.
• Knowledge of data architecture, retention policies, performance monitoring, and infrastructure advising.
• Understanding of data governance, warehousing, and both structured and unstructured data.
• Practical experience with ETL tools and big database systems like Hadoop, BigQuery, and cloud databases.
• Experience with Hive, Impala, Spark, Kafka, and operating systems (preferred).
• Exposure to machine learning, data science, AI, and related fields.
• Knowledge of Industry 4.0 applications and related technologies.

Authority/Decision Making:

Operates within broad policies and standards, determining priorities and processes to achieve objectives, with some decisions requiring approval.

Agile/Digital Skills & Individual Skills:

• Experience working in Agile teams.
• Self-motivated with strong problem-solving skills.
• Flexible and adaptable to changing project directions.
• Excellent communication, listening, and influencing skills.
• Ability to work abstractly, gain consensus, and adjust to stakeholder input.