Senior Data Warehouse Engineer

Different Technologies Pty Ltd.; Riyadh; On-site; USD 60,000 - 90,000; Full time

Job summary

A leading technology company is seeking a Senior Data Warehouse Engineer specializing in map data. You will be responsible for architecting scalable data warehouse solutions, developing ETL processes, and ensuring data governance and performance tuning. The ideal candidate should have a strong background in SQL, geospatial data, and data integration techniques, with at least 5 years of relevant experience.

Qualifications

• 5 years of experience in data warehouse design and implementation, focusing on geospatial data.
• Strong proficiency in SQL and database management systems, including spatial extensions.
• Knowledge of GIS tools and geospatial libraries such as GDAL and GeoPandas.

Responsibilities

• Lead the design and development of the map data warehouse architecture.
• Design and optimize ETL pipelines for map data processing.
• Implement data governance and security for stored map data.

Skills

SQL

Data Modeling

ETL Development

Geospatial Data Handling

Performance Tuning

Data Integration

Education

Bachelor's or Master's degree in computer science, information systems, or a related field

Tools

PostgreSQL

MySQL

SQL Server

Apache Spark

Apache Airflow

Talend

Job description

As a Senior Data Warehouse Engineer specializing in map data warehouse, you will play a crucial role in designing, implementing, and maintaining our map data warehouse infrastructure. You will be responsible for architecting scalable, efficient, and reliable data warehouse solutions.

Key Responsibilities:

1. Data Warehouse Architecture: Lead the design and development of our map data warehouse architecture, including data modeling, schema design, and ETL (Extract, Transform, Load) processes, to ensure scalability, performance, and data integrity for handling map data.
2. ETL Development: Design, develop, and optimize ETL pipelines to extract, transform, and load map data from various source systems, including geographic information systems (GIS), satellite imagery, and point of interest (POI) databases, into the data warehouse using tools and technologies such as SQL, Python, or ETL platforms.
3. Data Integration: Collaborate with cross-functional teams to integrate map data from disparate sources, including internal and external data providers, into the data warehouse to create a unified and comprehensive view of the organization's map data assets.
4. Performance Tuning: Identify and address performance bottlenecks in the map data warehouse environment, including query optimization, indexing strategies, and data partitioning techniques, to ensure optimal performance and scalability for handling large-scale map data.
5. Data Governance and Security: Implement data governance policies and security controls to ensure the confidentiality, integrity, and availability of map data stored in the data warehouse, in compliance with regulatory requirements and industry best practices.
6. Monitoring and Maintenance: Monitor the health and performance of the map data warehouse infrastructure, proactively identify and address issues, and perform routine maintenance tasks, such as backups, upgrades, and patching, to ensure system availability and reliability.

Qualifications:

• Bachelor's or Master's degree in computer science, information systems, or a related field.
• 5 years of experience in data warehouse design, development, and implementation, with a focus on handling geospatial or map data.
• Strong proficiency in SQL and database management systems, such as PostgreSQL, MySQL, or SQL Server, with experience in spatial extensions and GIS functionalities.
• Experience with ETL tools and frameworks, such as Apache Spark, Apache Airflow, or Talend, for handling large-scale map data processing and integration.
• Knowledge of geospatial data formats, GIS tools, and geospatial libraries such as GDAL, GeoPandas, or ArcGIS, and experience with spatial indexing and optimization techniques.
• Excellent problem-solving and analytical skills, with the ability to translate business requirements into technical solutions for map data warehouse solutions.
• Effective communication and collaboration skills, with the ability to work independently and as part of a multidisciplinary team.