Senior Specialist - Data Engineering

Qiddiya | القدية; Riyadh; On-site; SAR 230,000 - 320,000; Full time

Job summary

Qiddiya is seeking a Senior Data Engineer to transform raw data into scalable systems and enable analytics. You will architect and optimize data pipelines, collaborate with cross-functional teams, and drive data availability and reliability for decision making.

You'll work with Python/Java/Scala, SQL/NoSQL, and cloud services (GCP, AWS/Azure as needed) to build modern data platforms and support ML initiatives.

Qualifications

• Degree in Computer Science, IT, or similar field; a Master’s is a plus.
• Experience as a data engineer with Google Cloud Platform preferred.
• Proficiency in data models, data mining, and segmentation techniques.
• Programming in Python, Java, or Scala; SQL and NoSQL databases.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes.
• Deploy data pipelines on Dataflow, DataProc, Data Fusion, and Cloud Composer.
• Build distributed data stores and data architectures.
• Collaborate with data science, marketing, and customer success teams.
• Implement data quality checks, monitoring, and automation.

Skills

Python

Java

Scala

SQL

NoSQL

ETL

Data Modeling

Cloud Platforms

Education

Bachelor's degree in CS/IT or related field

Tools

Google Cloud Platform

Apache Spark

Apache Kafka

Apache Airflow

DataFlow

DataProc

Data Fusion

BigQuery

Job description

As a Senior Data Engineer, you will use various methods to transform raw data into useful data systems. Collaborate closely with cross-functional teams to ensure the availability, reliability, and accessibility of data for analytics and decision-making purposes. Overall, you\'ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes using tools such as Apache Spark, Apache Kafka, and Apache Airflow to ingest, process, and transform large volumes of data from various sources
• Deploy Data Pipeline on different Data Processing Product - DataFlow (Apache Beam), DataProc (Hadoop/Spark), Data Fusion, Cloud Composer(Airflow)
• Building distributed systems and data stores
• Collaborating with and supporting data science, marketing, and customer success teams in data acquisition and tool integration
• Configuration of Google Cloud Platform services
• Implement and optimize data storage solutions, including data warehouses (e.g., Amazon Redshift, Google BigQuery), data lakes (e.g., AWS S3, Azure Data Lake Storage), and NoSQL databases (e.g., MongoDB, Cassandra)
• Work closely with data architects to design and implement efficient data models using dimensional modeling techniques (e.g., star schema, snowflake schema) that support business requirements and enable effective data analysis
• Collaborate with data scientists and analysts to understand data requirements and develop solutions to support advanced analytics and machine learning initiatives, including model training and deployment
• Implement data quality checks, monitoring and custom scripts to ensure the accuracy, completeness, and reliability of data
• Participate in troubleshooting and resolving data-related issues, ensuring timely resolution and minimal disruption to business operations
• Stay updated on emerging technologies and best practices in data engineering, including cloudnative solutions and serverless architectures, and contribute to the continuous improvement of data platforms and infrastructure
• Solid knowledge of Google\'s BigQuery for effective data processing
• Proposing and implementing repetitive tasks automation
• Providing support for development teams in deployment-related topics
• Modernizing data lakes and data warehouses

Requirements

• Degree in Computer Science, IT, or similar field; a Master\'s is a plus.
• Previous experience as a data engineer or in a similar role. Google Cloud Platform is preferrable.
• Technical expertise with data models, data mining, and segmentation techniques
• Proficiency in programming languages such as Python, Java, or Scala, and experience with SQL and NoSQL databases.
• Strong understanding of data modeling, ETL processes, data warehousing concepts, and data integration techniques
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with related services (e.g., AWS Glue, Azure Data Factory, Google BigQuery).
• Excellent problem-solving skills and attention to detail, with the ability to work effectively in a fast paced environment and manage multiple priorities.
• Strong communication and interpersonal skills, with the ability to collaborate effectively with cross functional teams and stakeholders.
• Data engineering cloud certification (e.g Google Certified Data Engineer) is a plus.