Senior Data Engineer — Platform & AI Enablement

Rad Resources; Gauteng; On-site; ZAR 1,000,000 - 1,300,000; Full time

Job summary

Rad Resources seeks a seasoned Data Engineer to own the data platform and pipelines in Gauteng. You will design scalable ETL/ELT workflows, manage data warehouses, and partner with Cybersecurity and business teams to ensure quality, security, and compliance.

You will enable AI/ML capabilities with curated datasets and feature pipelines while driving automation and documentation across the data estate. This role emphasizes collaboration and reliable, scalable data solutions.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Technology or related field.
• 5+ years' experience in data engineering, data platform development, or similar role.
• Hands-on experience with Databricks, Azure Data Factory, Azure SQL and PostgreSQL.
• Experience designing and supporting data warehouses, data marts, and ETL/ELT pipelines.
• Knowledge of Lakehouse architecture, Spark, and cloud-based data platforms.
• Understanding of data governance, data security, and compliance with POPIA/GDPR.
• Experience with Power BI, Microsoft Fabric/Synapse, or Azure data ecosystem is advantageous.
• Exposure to AI/ML data pipelines, Azure OpenAI, or MLOps.
• Familiarity with CI/CD, IaC (Bicep/Terraform), and Agile delivery methods.
• Relevant Microsoft Azure or Databricks certifications desirable.

Responsibilities

• Data Platform Management: Maintain availability, performance and cost efficiency of data platforms and pipelines.
• Data Engineering & Pipelines: Design and operate robust ETL/ELT pipelines and lakehouse workflows.
• Data Governance & Security: Ensure data quality, lineage, cataloguing, security and access control.
• AI & Analytics Enablement: Enable AI/ML workloads with curated datasets and feature pipelines.
• Security & Compliance: Ensure data estate meets cybersecurity and data-protection standards.
• Automation & Continuous Improvement: Develop automation to improve operational efficiency and platform reliability.
• Collaboration & Stakeholder Engagement: Build relationships with Development, Cybersecurity and business stakeholders.
• Reporting & Documentation Discipline: Produce monthly reports and maintain up-to-date technical documentation.

Skills

Data governance

Security & compliance

CI/CD

Agile delivery

Stakeholder engagement

Cloud experience

Education

Bachelor's degree in Computer Science, Data Engineering, Information Technology

Tools

Databricks

Azure Data Factory

Azure SQL

PostgreSQL

Power BI

Microsoft Fabric/Synapse

Job description

Rad Resources seeks a seasoned Data Engineer to own the data platform and pipelines in Gauteng. You will design scalable ETL/ELT workflows, manage data warehouses, and partner with Cybersecurity and business teams to ensure quality, security, and compliance.

You will enable AI/ML capabilities with curated datasets and feature pipelines while driving automation and documentation across the data estate. This role emphasizes collaboration and reliable, scalable data solutions.