Data Engineer - Big Data & AI Platforms (Hybrid)

Placements24

LegKraal Gate

Hybrid

ZAR 700,000 - 1,100,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
retirement savings
Performance bonuses

Job summary

Placements24 is seeking a Data Engineer in Mahikeng, North West to design and maintain scalable data pipelines supporting AI/ML initiatives. You will work with big data tech and cloud services to ingest, store, and process large datasets, enabling data-driven insights.

Collaboration with data scientists and engineers is essential, with a focus on quality, security, and performance. The ideal candidate has 4+ years in data engineering, strong SQL skills, and hands-on experience with Spark,

Qualifications

  • Bachelor's or Master's degree in CS/Engineering/IS or related field.
  • Minimum 4 years of data engineering experience.
  • Strong SQL and relational DB experience.
  • Hands-on experience with Spark, Hadoop, Kafka.
  • Experience with cloud platforms (AWS, Azure, GCP) and data services.
  • Proficiency in Python or Scala for data processing.
  • Experience with data warehousing concepts and Kimball/Inmon methodologies.
  • Excellent problem-solving and communication skills.
  • Experience with Docker is a plus.

Responsibilities

  • Design, build, and maintain scalable data pipelines using big data technologies and cloud services.
  • Develop and optimize ETL/ELT processes for ingestion, transformation, and loading.
  • Implement data warehousing solutions and data lakes for analytics and AI/ML workloads.
  • Ensure data quality, integrity, and security across data platforms.
  • Collaborate with data scientists, analysts, and engineers on data requirements.
  • Monitor and troubleshoot data pipelines for performance and reliability.
  • Document data architectures and governance practices.

Skills

SQL proficiency
Data modeling
Problem solving
Communication skills

Education

Bachelor's or Master's degree in Computer Science/Engineering/Information Systems

Tools

PostgreSQL
MySQL
Apache Spark
Hadoop
Kafka
Python
Scala

Job description

Placements24 is seeking a Data Engineer in Mahikeng, North West to design and maintain scalable data pipelines supporting AI/ML initiatives. You will work with big data tech and cloud services to ingest, store, and process large datasets, enabling data-driven insights.

Collaboration with data scientists and engineers is essential, with a focus on quality, security, and performance. The ideal candidate has 4+ years in data engineering, strong SQL skills, and hands-on experience with Spark,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer: AI Platforms & Scalable Pipelines
Data Engineer: AI Platforms & Scalable Pipelines

Placements24 • Upington

On-site
ZAR 600,000 - 900,000
Competitive salary
Medical aid
Retirement plan
+2
Data Engineer - Big Data & AI Platforms
Data Engineer - Big Data & AI Platforms

Placements24 • LegKraal Gate

Hybrid
ZAR 700,000 - 1,100,000
Health insurance
retirement savings
Performance bonuses
Hybrid Data Engineer for Big Data Platforms
Hybrid Data Engineer for Big Data Platforms

Placements24 • Stellenbosch Local Municipality

Hybrid
ZAR 480,000 - 800,000
Medical aid
Provident fund
Paid vacation time
+2
Senior AI Engineer - Hybrid Big Data ML Systems
Senior AI Engineer - Hybrid Big Data ML Systems

Placements24 • South Africa

Hybrid
ZAR 800,000 - 1,200,000
Lead Big Data Engineer - Hybrid, Data Lakes & Pipelines
Lead Big Data Engineer - Hybrid, Data Lakes & Pipelines

Placements24 • Upington

Hybrid
ZAR 1,200,000 - 1,800,000
Health benefits
Hybrid work model
Performance bonuses
+1
AI/ML Data Engineer - Scalable ETL Pipelines
AI/ML Data Engineer - Scalable ETL Pipelines

Placements24 • Johannesburg

On-site
ZAR 600,000 - 900,000
Medical insurance
Dental insurance
Vision insurance
+4
Senior Data Engineer - Hybrid: AI Data Pipelines
Senior Data Engineer - Hybrid: AI Data Pipelines

Placements24 • Stellenbosch

Hybrid
ZAR 900,000 - 1,300,000
Performance bonuses
Health insurance
Retirement plan
+3
Hybrid Senior Data Engineer - Big Data & ETL Pipelines
Hybrid Senior Data Engineer - Big Data & ETL Pipelines

Placements24 • Sandton

Hybrid
ZAR 900,000 - 1,600,000
Competitive salary
Hybrid work arrangement
Professional development opportunities
+2
Data Engineer - AI Platforms
Data Engineer - AI Platforms

Placements24 • Upington

On-site
ZAR 600,000 - 900,000
Competitive salary
Medical aid
Retirement plan
+2
Senior AI/ML Software Engineer - Hybrid (Mahikeng)
Senior AI/ML Software Engineer - Hybrid (Mahikeng)

Placements24 • LegKraal Gate

Hybrid
ZAR 1,200,000 - 1,800,000
Competitive salary
Health benefits
Performance bonuses
+2