Senior Data Engineer

Astek Middle East; Ar Rass; On-site; SAR 150,000 - 200,000; Full time

Job summary

A leading data solutions provider in Saudi Arabia is seeking a Senior Data Engineer to design and optimize scalable data pipelines within the Cloudera ecosystem. The ideal candidate will have over 10 years of experience in data engineering and proficiency in SQL, Python, and various data integration techniques. This role emphasizes collaboration with cross-functional teams and requires a strong focus on data quality and compliance.

Qualifications

• 10+ years of professional experience in data engineering.
• Proven hands-on expertise with the Cloudera ecosystem.
• Advanced knowledge of SQL and Python.

Responsibilities

• Design, build, and optimize scalable and reliable data pipelines.
• Develop ETL/ELT processes for diverse data sources.
• Monitor, maintain, and troubleshoot daily data pipelines.

Skills

ETL/ELT development

Data integration

Big data performance optimization

SQL

Python

Data modeling techniques

Collaboration

Problem-solving skills

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Cloudera ecosystem (Spark, Hive, Kafka, HDFS)

CI/CD tools

Version control systems (Git)

Job description

We are seeking a highly experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and architectures within the Cloudera ecosystem. The ideal candidate will have strong expertise in ETL/ELT development, data integration, and big data performance optimization to support analytics and business objectives.

Key Responsibilities

• Design, build, and optimize scalable and reliable data pipelines and architectures.
• Develop ETL/ELT processes for structured, semi-structured, and unstructured data sources.
• Collaborate with data scientists, analysts, and stakeholders to ensure data availability and usability.
• Ensure data quality, integrity, and compliance across multiple platforms.
• Optimize database queries and big data processing for high performance.
• Monitor, maintain, and troubleshoot daily data pipelines and ETL jobs.
• Implement automation and monitoring tools to ensure reliability and efficiency.
• Document processes, workflows, incidents, and solutions to support knowledge sharing.

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 10+ years of professional experience in data engineering.
• Proven hands-on expertise with Cloudera ecosystem (Spark, Hive, Kafka, HDFS).
• Advanced knowledge of SQL, Python, and data modeling techniques.
• Strong understanding of data integration and data warehousing concepts.

Preferred Qualifications

• Experience with cloud platforms (AWS, GCP, or Azure).
• Knowledge of CI/CD tools and version control systems (Git).
• Exposure to real-time data streaming (Kafka, Flink).
• Arabic Fluency

Key Competencies

• Strong problem-solving and analytical skills.
• Ability to design efficient and scalable solutions.
• Effective collaboration and communication with cross-functional teams.
• Attention to detail with a strong focus on data quality.