Senior Big Data Platform Engineer (On-site Doha)

Holding Group; Doha; On-site; QAR 360,000 - 600,000; Full time

Job summary

Holding Group in Doha, DAW, QA is seeking an experienced Big Data Platform Developer to join our technology and data engineering team. The role focuses on designing, developing, and maintaining scalable big data platforms for analytics, BI, AI, and ML initiatives.

The ideal candidate has hands-on experience with Spark, Hadoop, Kafka, ETL/ELT pipelines, and cloud-based data architectures. This is an on-site position in Doha with opportunities for career growth and impact.

Qualifications

• Bachelor's degree or higher in a relevant field.
• 5+ years of data engineering or big data development experience.
• Proficient in Python, Java, or Scala.
• Strong Spark experience and distributed data processing.
• Hands-on with ETL/ELT pipelines.
• SQL and relational database expertise.
• Experience with large-scale storage and processing architectures.
• Understanding of data modeling and warehousing concepts.
• Linux/Unix experience.
• Solid grasp of SDLC, version control, testing, and deployment.

Responsibilities

• Design, develop, and maintain scalable Big Data platforms and data processing solutions.
• Develop and optimize high-volume, high-performance data pipelines for structured and unstructured data.
• Build reliable ETL/ELT pipelines for data ingestion, transformation, processing, and integration.
• Work with distributed data processing technologies such as Apache Spark, Hadoop, Kafka, and related platforms.
• Design and implement data ingestion from databases, APIs, applications, logs, IoT devices, and other data sources.
• Develop batch and real-time/streaming data processing solutions.
• Optimize data processing jobs, queries, storage, and platform performance.
• Implement data quality, validation, monitoring, and error-handling mechanisms.
• Develop scalable data storage solutions using data lakes, data warehouses, and modern data platforms.
• Integrate big data platforms with BI, analytics, AI, and ML environments.
• Implement security, access control, encryption, and governance requirements across data platforms.
• Monitor platform performance, availability, capacity, and reliability.
• Troubleshoot and resolve data pipeline and platform-related issues.
• Automate deployment, testing, monitoring, and operational processes.
• Collaborate with DevOps and Cloud teams to implement CI/CD and infrastructure automation.
• Develop technical documentation, architecture diagrams, standards, and operational procedures.
• Participate in technology evaluations and recommend solutions to improve scalability, performance, and cost efficiency.
• Stay current with emerging big data, cloud, data engineering, and analytics technologies.

Skills

Python

Java/Scala

Apache Spark

ETL/ELT

SQL

Data modeling

Linux/Unix

SDLC

Data integration

Education

Bachelor's degree in Computer Science, Information Technology, Software Engineering, Data Engineering, or a related field

Job description

Holding Group in Doha, DAW, QA is seeking an experienced Big Data Platform Developer to join our technology and data engineering team. The role focuses on designing, developing, and maintaining scalable big data platforms for analytics, BI, AI, and ML initiatives.

The ideal candidate has hands-on experience with Spark, Hadoop, Kafka, ETL/ELT pipelines, and cloud-based data architectures. This is an on-site position in Doha with opportunities for career growth and impact.