Senior Data Engineer

Goldenrule; South Africa; On-site; ZAR 600,000 - 900,000; Full time

Job summary

Goldenrule is seeking a seasoned Data Engineer to design and implement ETL pipelines, data models, and dashboards across large datasets. You will enable stakeholders to gain insights by building scalable data architectures and automated validation processes.

The role requires 5–7 years in ETL environments, strong SQL/NoSQL experience, and familiarity with cloud platforms like AWS and Azure. Collaboration with IT Operations and analytics teams is essential to drive data-driven decisions.

Qualifications

• Minimum 5–7 years in ETL framework driven environment.
• Experience with multiple databases (MSSQL, MySQL, PostgreSQL, NoSQL).
• Knowledge of Data Virtualization and Data Warehousing; adhere to standards.

Responsibilities

• Design and implement complex enterprise view reports in IT Operational Reporting tools.
• Maintain and improve data consolidation and automation from operational data.
• Collaborate with cross-functional teams to define data requirements and drive data initiatives.
• Develop and validate data models, ETL processes, and dashboards for stakeholders.
• Ensure data quality and provide actionable insights for planning and optimization.

Skills

ETL Frameworks

Data Modeling

Data Pipelines

Data Validation

Dashboards

SQL

NoSQL

Cloud Platforms

Databricks

AWS

Azure

Data Warehousing

Analytics

Education

Bachelor's degree or equivalent

Postgraduate qualification (advantageous)

Cloud Certifications (Databricks/AWS/Azure)

Tools

MSSQL

MySQL

PostgreSQL

NoSQL

Data Virtualization

AWS Data Services

Job description

Purpose of the Position

To collect and validate business information (which can then be used by data scientists and business stakeholders). To design and implement data models and architectures that enable business stakeholders to gain insights from large-scale datasets. To design and develop ETL processes, pipelines, and data validation processes to ensure accuracy and consistency of data. To identify valuable data assets, in order to reduce duplication and enable faster delivery of deeper insights to the ST Operational reporting. Identify key drivers and value creators within user journeys. Developing and maintaining dashboards, reports, and visualizations that provide insights into key business metrics and trends. To help the organizations leverage their data to make informed decisions and improve business outcomes.

Qualifications

Minimum suitable tertiary qualification or an equivalent. Post graduate qualification would be advantageous. Cloud Technology Certifications in Databricks, AWS, Azure, Data Engineering and other technologies highly advantageous.

Experience

A minimum of 5-7 years in ETL Framework driven environment. 5-7 years Multiple database experience advantageous: MSSQL/SQL, MySQL, Postgres SQL, No-SQL, Data Virtualization, AWS data. At least 5 years working experience. Knowledge of Data Virtualization and Data Warehousing. Ensure solutions adhere to standards and best practices and participate in solution reviews to ensure all solutions fit within standards. Operate within project environments and participate in CII continuous improvement efforts. Align to the division’s capability in using operational data to drive consolidated, reusable datasets, reducing data silos and duplication. Provide support to ST Executive Team comprised of IT Operations, Development and Program Management data. Identify opportunities to improve business as usual processes using modern technologies and automation. Work with cross-functional teams to identify data requirements, prioritize data initiatives, and drive solutions that enable data-driven decision making. Analyze operational data performance and effectiveness and provide actionable insights for future planning and optimization. Maintain, build and improve data consolidation and automation from operational data to package data for re-use. Design and implement complex enterprise view reports in existing IT Operational Reporting tools. Analyze and organize raw data. Be accountable for solutions, their sustainability and accuracy as well as delivery deadlines. Share knowledge and practical experience with community and team. Implement best practice Data warehousing development based on methodology adopted for solution by Architecture.