AI/ML Data Engineer — Big Data Platform Builder

Placements24; LegKraal Gate; On-site; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Health insurance

Retirement plans

Growth opportunities

Job summary

Placements24 is seeking an AI/ML Data Engineer to design, build, and maintain scalable data pipelines to support AI initiatives in Mahikeng, North West. You will work with data scientists and ML engineers, optimize ETL/ELT processes, ensure data quality and governance, and apply big data tools like Spark, Hadoop, and Kafka on cloud platforms (AWS/Azure/GCP).

Ideal candidates have 3+ years in data engineering, strong SQL, programming in Python/Scala/Java, and solid data modeling experience.

Qualifications

• Bachelor's or Master's in CS/Engineering or related field.
• 3+ years in data engineering for AI/ML projects.
• Proficiency in SQL and relational/NoSQL databases.
• Experience with Spark, Hadoop, Kafka, or similar.
• Cloud data platforms AWS/Azure/GCP and services like S3, Redshift, BigQuery.

Responsibilities

• Design, build, and maintain scalable data pipelines for AI/ML apps.
• Develop and manage ETL/ELT processes for ingestion, transformation, loading.
• Optimize storage and retrieval for large datasets using big data tech.
• Ensure data quality, integrity, and reliability across systems.
• Collaborate with AI/ML engineers and data scientists on data needs.
• Implement data governance and security best practices.
• Monitor data infrastructure performance and troubleshoot issues.
• Stay updated with trends in big data and data engineering.
• Contribute to architecture and design of the data platform.
• Document data processes, schemas, and infrastructure.

Skills

SQL

Python

Scala

Java

Data modeling

Big data

Teamwork

Communication

Education

Bachelor's degree

Master's degree

Tools

Spark

Hadoop

Kafka

AWS

Azure

GCP

S3

Redshift

BigQuery

NoSQL

Job description

Placements24 is seeking an AI/ML Data Engineer to design, build, and maintain scalable data pipelines to support AI initiatives in Mahikeng, North West. You will work with data scientists and ML engineers, optimize ETL/ELT processes, ensure data quality and governance, and apply big data tools like Spark, Hadoop, and Kafka on cloud platforms (AWS/Azure/GCP).

Ideal candidates have 3+ years in data engineering, strong SQL, programming in Python/Scala/Java, and solid data modeling experience.