AI-Driven Data Engineer for Scalable Pipelines

Placements24; Rustenburg; Hybrid; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Competitive salary

Health insurance

Paid time off

Professional development

Collaborative environment

Job summary

Placements24 in Rustenburg is seeking a Data Engineer with a strong focus on AI initiatives to join our dynamic team. You will design, construct, install, test, and maintain scalable data infrastructure powering AI and ML systems.

The ideal candidate will work with big data technologies and cloud platforms, ensuring data quality and governance while supporting AI applications at scale.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering, with exposure to AI/ML projects.
• Proficiency in SQL and NoSQL databases, data warehousing concepts, and data modeling.
• Experience with big data technologies (e.g., Spark, Hadoop) and cloud platforms (AWS, Azure, GCP).
• Programming skills in Python or Scala.
• Understanding of data pipeline orchestration tools (e.g., Airflow).

Responsibilities

• Design, build, and maintain scalable data pipelines for AI and machine learning applications.
• Develop and manage ETL/ELT processes to ensure data quality and availability.
• Optimize data storage and retrieval systems for performance and cost-efficiency.
• Implement data governance and security best practices.
• Collaborate with data scientists and ML engineers to understand their data needs.
• Monitor data infrastructure and troubleshoot any issues that arise.

Skills

SQL

Python

NoSQL

Data Modeling

ETL/ELT

Airflow

Education

Bachelor's degree in CS/Engineering or related field

Tools

Spark

Hadoop

AWS

Azure

GCP

Data Warehousing

Job description

Placements24 in Rustenburg is seeking a Data Engineer with a strong focus on AI initiatives to join our dynamic team. You will design, construct, install, test, and maintain scalable data infrastructure powering AI and ML systems.

The ideal candidate will work with big data technologies and cloud platforms, ensuring data quality and governance while supporting AI applications at scale.