Data Engineer

Plus1X Solutions (Pty) Ltd; Johannesburg; On-site; ZAR 500 000 - 750 000; Full time

Job summary

A technology solutions provider in Johannesburg seeks a Data Engineer to work closely with end-users and build robust data solutions. The ideal candidate should possess in-depth experience with T-SQL, SQL programming, and Azure technologies including Data Factory and Databricks. Responsibilities include maintaining the Enterprise Data Warehouse and ETL processes. This role offers a dynamic environment with opportunities for growth.

Qualifications

• Experience with T-SQL for data analysis.
• Strong SQL programming skills, including stored procedures and functions.
• Extensive experience with SQL Server and SSIS.

Responsibilities

• Work closely with end-users to understand business and data requirements.
• Perform ad hoc data analysis using Synapse Analytics and Databricks.
• Maintain the Enterprise Data Warehouse using Data Vault 2.0 methodology.

Skills

Data analysis

SQL programming

Azure Data Factory

Databricks

Data Vault 2.0 methodology

ETL processes

GIT

Job description

Responsibilities

• Working closely with end-users to understand their business and their data requirements.
• Ad hoc data analysis and ‘data wrangling’ using Synapse Analytics and Databricks.
• Building dynamic meta-data driven data ingestion patterns using Azure Data Factory and Databricks.
• Building and maintaining the Enterprise Data Warehouse (using Data Vault 2.0 methodology).
• Building and maintaining business focused data products and data marts.
• Building and maintaining Azure Analysis Services databases and cubes.
• Building ‘infrastructure-as-code’ deployment pipelines.
• Sharing support and operational duties within the engineering team.

Qualifications

• Experience in the following technologies are key to this role : .
• Excellent data analysis and exploration using T-SQL.
• Strong SQL programming (stored procedures, functions).
• Extensive experience with SQL Server and SSIS.
• Knowledge and experience of data warehouse modelling methodologies (Data Vault 2.0, Kimball).
• Experience in Azure – one or more of the following : Data Factory, Databricks, Synapse Analytics, ADLS Gen2.
• Experience in building robust and performant ETL processes.
• Build and maintain Analysis Services databases and cubes (both multidimensional and tabular).
• Experience in using source control, preferably GIT.
• Understanding and experience of deployment pipelines.