Data Engineering and Architecture Lead (AWS & Databricks) - Johannesburg - up to R2+ mil CTC

ATS Client; Johannesburg; On-site; ZAR 1,800,000 - 2,200,000; Full time

Job summary

ATS Client is seeking a Data Engineering and Architecture Lead in Johannesburg to drive the design and optimization of enterprise data platforms in a modern AWS cloud environment. You will mentor engineers and architects, align data initiatives with digital transformation, and partner with business teams to deliver high‑quality data solutions.

The role combines hands‑on architecture with leadership, supporting BI, analytics, and AI/ML initiatives while managing costs and platform performance in

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering or a related discipline.
• 8+ years of experience in Data Engineering, Data Architecture, or a related technical role.
• Proven hands-on experience with AWS Cloud services including S3, Glue, Redshift, EMR, Lambda, and Athena.
• Strong programming skills in SQL and Python.
• Advanced expertise in data modeling techniques (e.g., Kimball, Data Vault) and ETL/ELT development.
• Experience with DevOps practices and Infrastructure as Code (Terraform, CloudFormation).
• Previous experience in team leadership or managing technical teams.

Responsibilities

• Lead the design, deployment, and management of scalable, secure, and future‑ready data architectures.
• Develop and maintain robust ETL/ELT pipelines to integrate data from diverse sources.
• Design data models and structures that support analytics, BI, and AI/ML initiatives.
• Partner with data science, BI, and business teams to ensure high data quality, accessibility, and performance.
• Define and enforce engineering standards, best practices, and data governance frameworks.
• Drive platform automation, optimize performance, and manage costs effectively.
• Mentor and guide data engineers and architects, fostering skills development and knowledge sharing.
• Monitor emerging trends in data engineering and cloud technologies, recommending enhancements to the data platform.

Skills

SQL

Python

AWS Cloud Services

Data modeling

ETL/ELT

Leadership

Education

Bachelor's degree in Computer Science, Information Systems, Engineering

Tools

Terraform

CloudFormation

Job description

An exciting opportunity is available for an experienced Data Engineering and Architecture Lead to join a dynamic IT division. In this role, you will drive the design, development, and optimization of enterprise‑scale data platforms, enabling advanced analytics, seamless data integration, and high‑impact business intelligence within a modern AWS cloud environment.

You will lead and mentor a team of engineers and architects, fostering best practices and ensuring the delivery of secure, scalable, and high‑performance data solutions. Working closely with key stakeholders, you will align data architecture initiatives with broader digital transformation objectives, playing a critical role in shaping the organization’s data strategy and long‑term technology vision.

Responsibilities

• Lead the design, deployment, and management of scalable, secure, and future‑ready data architectures.
• Develop and maintain robust ETL/ELT pipelines to integrate data from diverse sources.
• Design data models and structures that support analytics, BI, and AI/ML initiatives.
• Partner with data science, BI, and business teams to ensure high data quality, accessibility, and performance.
• Define and enforce engineering standards, best practices, and data governance frameworks.
• Drive platform automation, optimize performance, and manage costs effectively.
• Mentor and guide data engineers and architects, fostering skills development and knowledge sharing.
• Monitor emerging trends in data engineering and cloud technologies, recommending enhancements to the data platform.

Qualifications and experience

• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related discipline.
• 8+ years of experience in Data Engineering, Data Architecture, or a related technical role.
• Proven hands‑on experience with AWS Cloud services including S3, Glue, Redshift, EMR, Lambda, and Athena.
• Strong programming skills in SQL and Python.
• Advanced expertise in data modeling techniques (e.g., Kimball, Data Vault) and ETL/ELT development.
• Experience with DevOps practices and Infrastructure as Code (Terraform, CloudFormation).
• Previous experience in team leadership or managing technical teams is essential.

The Reference Number for this position is NG60852 which is a Permanent, Hybrid role in Johannesburg offering a salary of up to R2+mil CTC negotiable based on experience. E‑mail Nokuthula on [email protected] or call her for a chat on 011 463 3633 to discuss this and other opportunities.