Data Engineer

BigTalent; Gauteng; On-site; ZAR 600,000 - 1,000,000; Full time

Job summary

BigTalent is seeking talented Data Engineers to design, build, and optimise cloud-based data platforms across industries. You will collaborate with Data Scientists, AI Engineers, and Consultants on complex client projects to deliver scalable data solutions.

You should have 3–5 years in data engineering, strong Python and SQL skills, and experience with AWS; Azure is a plus. A Bachelor's degree in Computer Science or related field is required, with Terraform knowledge as a plus.

Qualifications

• Minimum 3–5 years of data engineering experience.
• Strong Python and SQL skills.
• Experience with AWS; Azure experience is advantageous.
• Experience with ETL/ELT, data modeling and data architecture.
• Bachelor's degree in Computer Science, Engineering or related field.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Develop robust data models and architectures for enterprise data platforms.
• Build and optimise SQL databases and data warehouses.
• Deploy and manage cloud-based data solutions (AWS preferred).
• Implement CI/CD pipelines and Infrastructure as Code (Terraform preferred).
• Ensure data governance, security, and best practice standards.
• Monitor, troubleshoot, and optimise production data pipelines.
• Collaborate with cross-functional teams to deliver data-driven solutions.

Skills

Python

SQL

AWS

Azure

ETL/ELT

Data modelling

Data architecture

Education

Bachelor's degree in Computer Science or related field

Tools

Terraform

Job description

We're looking for talented Data Engineers to join a global Data & AI consulting firm delivering enterprise-scale data platforms and AI solutions across multiple industries.

In this role, you'll design, build, and optimise modern cloud-based data platforms while working alongside experienced Data Scientists, AI Engineers, and Consultants on complex client projects.

What You'll Do:

• Design, build, and maintain scalable data pipelines and ETL/ELT processes
• Develop robust data models and architectures for enterprise data platforms
• Build and optimise SQL databases and data warehouses
• Deploy and manage cloud-based data solutions (AWS preferred, Azure experience beneficial)
• Implement CI/CD pipelines and Infrastructure as Code (Terraform preferred)
• Ensure data governance, security, and best practice standards
• Monitor, troubleshoot, and optimise production data pipelines
• Collaborate with cross-functional teams to deliver data-driven solutions

Your Toolkit:

• 3–5 years' experience in Data Engineering or a similar role
• Strong Python and SQL skills
• Experience with AWS (Azure experience is advantageous)
• Solid understanding of ETL/ELT, data modelling and data architecture
• Experience with cloud infrastructure and scalable data platforms
• Knowledge of CI/CD and Infrastructure as Code (Terraform is a plus)
• Bachelor's degree in Computer Science, Engineering or a related field