Data Engineer

Plus1X Solutions (Pty) Ltd; Johannesburg; On-site; ZAR 400,000 - 800,000; Full time

Job summary

A leading company in data solutions is seeking a Data Engineer who will work closely with end-users to understand their data requirements. The ideal candidate will perform ad hoc data analysis, develop robust ETL processes using Azure services, and ensure the effective management of data warehouses. This role demands strong SQL programming skills and extensive experience with Azure Data Factory and Databricks.

Qualifications

• Strong SQL and T-SQL skills with experience in stored procedures.
• Experience with Azure Data services, especially Data Factory and Databricks.
• Knowledge of Data Vault 2.0 methodology.

Responsibilities

• Perform data analysis and data wrangling.
• Develop and maintain Enterprise Data Warehouse following Data Vault 2.0.
• Building and maintaining Azure Analysis Services databases.

Skills

Data analysis

SQL programming

ETL processes

Data warehouse modeling

Azure services

Tools

Databricks

Azure Data Factory

SQL Server

SSIS

Azure Analysis Services

Job description

Working closely with end-users to understand their business and their data requirements.

Performing ad hoc data analysis and 'data wrangling' using Synapse Analytics and Databricks.

Building dynamic, metadata-driven data ingestion patterns using Azure Data Factory and Databricks.

Developing and maintaining the Enterprise Data Warehouse following Data Vault 2.0 methodology.

Creating and managing business-focused data products and data marts.

Building and maintaining Azure Analysis Services databases and cubes.

Sharing support and operational duties within the engineering team.

Key technologies for this role include:

• Excellent data analysis and exploration using T-SQL.
• Strong SQL programming skills, including stored procedures and functions.
• Extensive experience with SQL Server and SSIS.
• Knowledge of data warehouse modeling methodologies such as Data Vault 2.0 and Kimball.
• Experience with Azure services like Data Factory, Databricks, Synapse Analytics, and ADLS Gen2.
• Experience in building robust and performant ETL processes.
• Building and maintaining Analysis Services databases and cubes (multidimensional and tabular).
• Experience with source control systems, preferably GIT.
• Understanding deployment pipelines.