Developer II | Retail IT | BI

Allan Gray Group; Cape Town; On-site; ZAR 900,000 - 1,300,000; Full time

Job summary

Allan Gray Group is seeking a Developer II for Retail IT Data Platform to modernise and evolve our data warehouse and Snowflake-based analytics platform.

You will design, develop, and support data pipelines, ELT workloads, and data models across Snowflake and SQL Server environments while helping establish DataOps practices.

Qualifications

• 3-5 years' experience in data engineering or BI development.
• Strong SQL and complex query troubleshooting experience.
• Experience with ETL/ELT pipelines and data warehousing concepts.
• Familiarity with cloud platforms such as AWS or Snowflake.
• Experience with Git-based workflows and CI/CD concepts.

Responsibilities

• Design, develop, and maintain Snowflake and SQL Server data pipelines.
• Develop ELT workloads, stored procedures, data models and transformations.
• Build and maintain Dagster assets, schedules, and orchestration workflows.
• Implement data quality, testing, and validation mechanisms.
• Contribute to CI/CD pipelines and deployment automation.
• Provide production support and incident resolution for data platforms.
• Collaborate with architects to modernize legacy ETL and data platform architecture.
• Create technical documentation, runbooks, and support artefacts.

Skills

Attention to detail

Analytical skills

Strong communication

Accurate estimates

Work under pressure

Education

Degree or diploma in information science or related technical discipline

Tools

Snowflake

Microsoft SQL Server

SSIS/SSRS/SSAS

Python

Dagster

Job description

Career Opportunities: Developer II | Retail IT | BI (9174)

Join the Retail IT Data Platform and Warehousing Development team in modernising and evolving both our Microsoft SQL Server-based data warehouse and Snowflake-based analytical platform. The role contributes to the development, support, and evolution of data products and operational processes across both environments, while helping establish modern DataOps practices.

Job Responsibilities

Design, develop, and maintain data pipelines and data products using Snowflake, Microsoft SQL Server and MSSQL Data tools (SSIS, SSRS, SSAS), Python, and Dagster.
Develop and optimize ELT workloads, stored procedures, data models, and transformation logic to support analytical and operational reporting requirements.
Build and maintain Dagster assets, schedules, sensors, and orchestration workflows to ensure reliable and observable data processing.
Design and implement data models for both operational and analytical use cases, applying appropriate warehousing and dimensional modelling techniques.
Troubleshoot and resolve data quality, pipeline, orchestration, and platform issues across Snowflake and SQL Server environments.
Analyze and optimize query performance, pipeline execution, warehouse utilization, and storage strategies.
Develop automated testing, reconciliation, and data validation mechanisms to improve platform reliability and data quality.
Contribute to CI/CD pipelines, deployment automation, source control standards, and engineering best practices.
Implement monitoring, alerting, observability, and operational controls to improve platform availability and supportability.
Collaborate with architects and senior engineers to modernize legacy ETL processes and evolve the team's data platform architecture.
Conduct code reviews and contribute to technical design discussions, ensuring solutions align with team standards, security requirements, and architectural principles.
Create and maintain technical documentation, platform runbooks, operational procedures, and support artefacts.
Investigate emerging technologies and contribute to technical spikes and proof-of-concepts that improve platform capabilities.
Provide production support for critical data platforms, participating in incident diagnosis, root-cause analysis, and resolution activities

Requirements

3-5 years' experience in data engineering, data warehousing, BI development, or a related field.
Strong SQL skills with experience developing and troubleshooting complex queries.
Experience building and supporting ETL/ELT pipelines.
Understanding of dimensional modelling and data warehousing concepts.
Experience working with large datasets and data integration processes.
Exposure to cloud platforms such as AWS or Snowflake.
Experience with Git-based source control and development workflows.
Understanding of CI/CD concepts and deployment automation.
Familiarity with Infrastructure-as-Code concepts.
Experience supporting production data platforms and resolving operational issues.
Understanding of monitoring, logging, and observability principles.
Exposure to automated testing and data quality practices.
Strong troubleshooting and analytical skills.
Experience with Python, SQL, MSSQL or similar data engineering technologies.
Understanding of software development lifecycle practices.
Familiarity with Agile delivery methodologies.

Skills and Competencies

Attention to detail and quality of work.
Ability to take initiative and responsibility.
Strong analytical skills.
Good communication
Provide accurate estimates
Present solutions clearly
Ability to work well under pressure and meet deadlines without sacrificing quality.

Education

Degree or diploma in information science or related technical discipline
Knowledge of financial concepts and terms and interested in attending courses to improve business knowledge
Financial Services industry experience would be an advantage