Fabric Data Engineer — Pipelines, Warehousing & Bi

Cls; Pretoria; On-site; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Competitive salary

On-site facilities

Medical, dental, and vision insurance

Professional development opportunities

Collaborative team culture

Job summary

Cls is seeking a meticulous Data Engineer to design, build and optimize scalable data pipelines for AI initiatives in Centurion. You will ensure data availability and quality for ML models, working closely with data scientists and ML engineers to architect robust data solutions.

This on-site role offers a collaborative environment with access to advanced facilities and opportunities for professional development.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering or related field.
• 3+ years of data engineering experience building large-scale data pipelines.
• Strong SQL and programming skills (Python/Scala).
• Experience with big data tech like Spark, Hadoop, Kafka and distributed storage.
• Hands-on with cloud data services (AWS/Azure/GCP) and data warehousing concepts.

Responsibilities

• Design, build and maintain scalable data pipelines and architectures.
• Ensure data quality, availability and accessibility for ML models and AI apps.
• Collaborate with data scientists/ML engineers to meet data requirements.
• Monitor data flows and optimize ETL/ELT processes for performance.
• Implement data security and governance best practices.

Skills

SQL

Python/Scala

Analytical thinking

Team collaboration

Education

Bachelor's or Master's in CS/Engineering

Tools

Spark

Hadoop

Kafka

AWS

Azure

GCP

Job description

Our client is seeking a meticulous and experienced Data Engineer to build and optimize robust data pipelines for their AI & Emerging Technologies initiatives in Centurion . In this critical role, you will be responsible for ensuring the availability, quality, and accessibility of data required for machine learning models and AI-driven applications. You will work closely with data scientists and ML engineers to architect scalable data solutions, fostering a data-centric culture. This on-site position provides a unique opportunity to work with a dedicated team in a collaborative and innovative environment.

About the Role

Our client is seeking a meticulous and experienced Data Engineer to build and optimize robust data pipelines for their AI & Emerging Technologies initiatives in Centurion . In this critical role, you will be responsible for ensuring the availability, quality, and accessibility of data required for machine learning models and AI-driven applications. You will work closely with data scientists and ML engineers to architect scalable data solutions, fostering a data-centric culture. This on-site position provides a unique opportunity to work with a dedicated team in a collaborative and innovative environment.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and pipelines.
• Develop processes and systems to monitor data quality, ensure consistency, and manage data flow.
• Build and manage ETL/ELT processes for large, diverse datasets.
• Optimize data infrastructure for performance, reliability, and cost-effectiveness.
• Collaborate with data scientists and ML engineers to understand their data requirements and provide solutions.
• Implement data security and governance best practices.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering, with a focus on building large-scale data pipelines.
• Proficiency in SQL and programming languages like Python or Scala.
• Experience with big data technologies such as Spark, Hadoop, Kafka, and distributed storage systems.
• Hands-on experience with cloud data services (AWS, Azure, GCP).
• Strong understanding of data warehousing concepts and database design.

Benefits

• Competitive annual salary and performance incentives.
• On-site work environment with access to advanced facilities.
• Comprehensive medical, dental, and vision insurance plans.
• Opportunities for professional development and certifications.
• Collaborative team atmosphere focused on innovation and growth.