Developer II | Retail IT | BI

Allan Gray; Cape Town; On-site; ZAR 900,000 - 1,300,000; Full time

Job summary

Allan Gray is seeking a Data Platform Engineer to modernise and evolve both SQL Server-based data warehouse and Snowflake analytical platform. You will contribute to data products, pipelines, and operational processes across environments while helping establish DataOps practices.

You will design, develop, and optimize ELT workloads, data models, and orchestration workflows with Dagster, Python, and SQL Server tools.

Qualifications

• 3-5 years' experience in data engineering, data warehousing, BI development, or related field.
• Strong SQL skills with experience developing and troubleshooting complex queries.
• Experience building and supporting ETL/ELT pipelines.
• Understanding of dimensional modelling and data warehousing concepts.
• Experience with large datasets and data integration processes.
• Exposure to cloud platforms such as AWS or Snowflake.
• Experience with Git-based source control and development workflows.
• Understanding of CI/CD concepts and deployment automation.
• Familiarity with Infrastructure-as-Code concepts.
• Experience supporting production data platforms and resolving operational issues.
• Understanding of monitoring, logging, and observability principles.
• Exposure to automated testing and data quality practices.

Responsibilities

• Design, develop, and maintain data pipelines and data products using Snowflake, Microsoft SQL Server and MSSQL Data tools (SSIS, SSRS, SSAS), Python, and Dagster.
• Develop and optimize ELT workloads, stored procedures, data models, and transformation logic to support analytical and operational reporting requirements.
• Build and maintain Dagster assets, schedules, sensors, and orchestration workflows to ensure reliable and observable data processing.
• Design and implement data models for both operational and analytical use cases, applying warehousing and dimensional modelling techniques.
• Troubleshoot and resolve data quality, pipeline, orchestration, and platform issues across Snowflake and SQL Server environments.
• Analyze and optimize query performance, pipeline execution, warehouse utilization, and storage strategies.
• Develop automated testing, reconciliation, and data validation mechanisms to improve platform reliability and data quality.
• Contribute to CI/CD pipelines, deployment automation, source control standards, and engineering best practices.
• Implement monitoring, alerting, observability, and operational controls to improve platform availability and supportability.
• Collaborate with architects and senior engineers to modernize legacy ETL processes and evolve the team's data platform architecture.
• Conduct code reviews and contribute to technical design discussions, ensuring solutions align with team standards, security requirements, and architectural principles.
• Create and maintain technical documentation, platform runbooks, operational procedures, and support artefacts.
• Investigate emerging technologies and contribute to technical spikes and proof-of-concepts that improve platform capabilities.
• Provide production support for critical data platforms, participating in incident diagnosis, root‑cause analysis, and resolution activities

Skills

Attention to detail

Initiative

Analytical thinking

Communication

Estimation & planning

Presentation of solutions

Pressure handling

Education

Degree or diploma in information science or related technical discipline

Financial concepts knowledge

Financial Services experience (advantage)

Tools

Snowflake

SQL Server

MSSQL Data tools (SSIS, SSRS, SSAS)

Python

Dagster

Git

Infrastructure-as-Code (Terraform)

Job description

Job Summary

Join the Retail IT Data Platform and Warehousing Development team in modernising and evolving both our Microsoft SQL Server-based data warehouse and Snowflake-based analytical platform. The role contributes to the development, support, and evolution of data products and operational processes across both environments, while helping establish modern DataOps practices.

Job Responsibilities

• Design, develop, and maintain data pipelines and data products using Snowflake, Microsoft SQL Server and MSSQL Data tools (SSIS, SSRS, SSAS), Python, and Dagster.
• Develop and optimize ELT workloads, stored procedures, data models, and transformation logic to support analytical and operational reporting requirements.
• Build and maintain Dagster assets, schedules, sensors, and orchestration workflows to ensure reliable and observable data processing.
• Design and implement data models for both operational and analytical use cases, applying appropriate warehousing and dimensional modelling techniques.
• Troubleshoot and resolve data quality, pipeline, orchestration, and platform issues across Snowflake and SQL Server environments.
• Analyze and optimize query performance, pipeline execution, warehouse utilization, and storage strategies.
• Develop automated testing, reconciliation, and data validation mechanisms to improve platform reliability and data quality.
• Contribute to CI/CD pipelines, deployment automation, source control standards, and engineering best practices.
• Implement monitoring, alerting, observability, and operational controls to improve platform availability and supportability.
• Collaborate with architects and senior engineers to modernize legacy ETL processes and evolve the team's data platform architecture.
• Conduct code reviews and contribute to technical design discussions, ensuring solutions align with team standards, security requirements, and architectural principles.
• Create and maintain technical documentation, platform runbooks, operational procedures, and support artefacts.
• Investigate emerging technologies and contribute to technical spikes and proof-of-concepts that improve platform capabilities.
• Provide production support for critical data platforms, participating in incident diagnosis, root‑cause analysis, and resolution activities

Requirements

• 3-5 years' experience in data engineering, data warehousing, BI development, or a related field.
• Strong SQL skills with experience developing and troubleshooting complex queries.
• Experience building and supporting ETL/ELT pipelines.
• Understanding of dimensional modelling and data warehousing concepts.
• Experience working with large datasets and data integration processes.
• Exposure to cloud platforms such as AWS or Snowflake.
• Experience with Git-based source control and development workflows.
• Understanding of CI/CD concepts and deployment automation.
• Familiarity with Infrastructure-as-Code concepts.
• Experience supporting production data platforms and resolving operational issues.
• Understanding of monitoring, logging, and observability principles.
• Exposure to automated testing and data quality practices.
• Strong troubleshooting and analytical skills.
• Experience with Python, SQL, MSSQL or similar data engineering technologies.
• Understanding of software development lifecycle practices.
• Familiarity with Agile delivery methodologies.

Skills And Competencies

• Attention to detail and quality of work.
• Ability to take initiative and responsibility.
• Strong analytical skills.
• Good communication
• Provide accurate estimates
• Present solutions clearly
• Ability to work well under pressure and meet deadlines without sacrificing quality.

Education

• Degree or diploma in information science or related technical discipline
• Knowledge of financial concepts and terms and interested in attending courses to improve business knowledge
• Financial Services industry experience would be an advantage

Location and Closing date

Cape Town
10 November 2026