Data Engineer: Scalable Pipelines for AI/ML (On-site)

Cls; Pretoria; On-site; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Competitive salary

On-site facilities

Medical, dental, and vision insurance

Professional development opportunities

Collaborative team culture

Job summary

Cls is seeking a meticulous Data Engineer to design, build and optimize scalable data pipelines for AI initiatives in Centurion. You will ensure data availability and quality for ML models, working closely with data scientists and ML engineers to architect robust data solutions.

This on-site role offers a collaborative environment with access to advanced facilities and opportunities for professional development.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering or related field.
• 3+ years of data engineering experience building large-scale data pipelines.
• Strong SQL and programming skills (Python/Scala).
• Experience with big data tech like Spark, Hadoop, Kafka and distributed storage.
• Hands-on with cloud data services (AWS/Azure/GCP) and data warehousing concepts.

Responsibilities

• Design, build and maintain scalable data pipelines and architectures.
• Ensure data quality, availability and accessibility for ML models and AI apps.
• Collaborate with data scientists/ML engineers to meet data requirements.
• Monitor data flows and optimize ETL/ELT processes for performance.
• Implement data security and governance best practices.

Skills

SQL

Python/Scala

Analytical thinking

Team collaboration

Education

Bachelor's or Master's in CS/Engineering

Tools

Spark

Hadoop

Kafka

AWS

Azure

GCP

Job description

Cls is seeking a meticulous Data Engineer to design, build and optimize scalable data pipelines for AI initiatives in Centurion. You will ensure data availability and quality for ML models, working closely with data scientists and ML engineers to architect robust data solutions.

This on-site role offers a collaborative environment with access to advanced facilities and opportunities for professional development.