Data Pipeline Engineer: Spark, Python & dbt

Confidential; Saudi Arabia; On-site; SAR 180,000 - 240,000; Full time

Job summary

Confidential is seeking a Big Data Engineer to develop, maintain, and optimize data pipelines and infrastructure supporting reporting, analytics, and business intelligence across the organization.

The role collaborates with multiple data sources to ensure reliable, accurate, and accessible data for operational and management decision-making. Proficiency in Python, SQL, Apache Spark/PySpark, and dbt is required.

Qualifications

• Bachelor's degree required in a related field.
• 2+ years of experience in Data Engineering, Data Integration, BI, or a related technical role.
• Strong knowledge of Python, SQL, Spark/PySpark & dbt.

Responsibilities

• Develop and maintain scalable data pipelines using Python and Apache Spark for batch and streaming data processing.
• Build and maintain data transformation workflows using dbt, ensuring data accuracy, consistency and quality.
• Extract, integrate, and validate data from multiple operational systems and databases.

Skills

Python

SQL

Apache Spark/PySpark

dbt

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related field

Job description

Confidential is seeking a Big Data Engineer to develop, maintain, and optimize data pipelines and infrastructure supporting reporting, analytics, and business intelligence across the organization.

The role collaborates with multiple data sources to ensure reliable, accurate, and accessible data for operational and management decision-making. Proficiency in Python, SQL, Apache Spark/PySpark, and dbt is required.