AI Platforms Data Engineer: Build Scalable Pipelines

Placements24; Rustenburg; Hybrid; ZAR 650,000 - 900,000; Full time

Benefits offered by this job

Competitive salary

Health insurance

Pension plan

Professional development

Rustenburg-based team environment

Job summary

Placements24 in Rustenburg is seeking a skilled Data Engineer to design, build, and maintain robust data infrastructure for AI initiatives. You''ll collaborate with data scientists and ML engineers to ensure reliable data for models and analytics, focusing on scalable pipelines and efficient storage.

The role requires a 3+ year background in data engineering, SQL and Python, plus hands-on with Airflow and big data frameworks in cloud environments.

Qualifications

• Bachelor's degree in CS, Engineering, or related field.
• 3+ years of data engineering experience with big data tech.
• Proficient in SQL and Python.
• Experience with Airflow and distributed processing frameworks.
• Familiar with cloud data services (AWS, Azure).

Responsibilities

• Design and maintain scalable data pipelines for AI/ML workloads.
• Develop data warehousing and data lake architectures.
• Implement data quality checks and ensure data integrity.
• Optimize processing performance and cost efficiency.
• Collaborate with data scientists and ML engineers to meet data needs.

Skills

SQL

Python

Airflow

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Airflow

Spark

Hadoop

AWS S3

Redshift

Glue

Azure Data Factory

Synapse

Job description

Placements24 in Rustenburg is seeking a skilled Data Engineer to design, build, and maintain robust data infrastructure for AI initiatives. You''ll collaborate with data scientists and ML engineers to ensure reliable data for models and analytics, focusing on scalable pipelines and efficient storage.

The role requires a 3+ year background in data engineering, SQL and Python, plus hands-on with Airflow and big data frameworks in cloud environments.