AI Platforms Data Engineer: Build Scalable Data Pipelines

Placements24; Gauteng; On-site; ZAR 650,000 - 950,000; Full time

Benefits offered by this job

Performance bonuses

Medical aid

Retirement fund contributions

Professional development budget

Centurion location

Job summary

Placements24 is seeking a dedicated Data Engineer in Centurion to build and optimize scalable data pipelines for AI platforms. You will ensure data availability, reliability, and performance for ML initiatives, handling large-scale datasets with modern tools.

The role requires 3+ years of data engineering experience, strong SQL, Python/Java skills, and familiarity with Spark/Hadoop and cloud data services. On-site work in Centurion offers opportunities for career growth and advanced data tooling

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 3+ years of experience as a Data Engineer or in a similar role focused on data infrastructure.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Strong programming skills in Python or Java, and experience with big data technologies (e.g., Spark, Hadoop).
• Familiarity with cloud data services (AWS, Azure, or GCP) and data warehousing concepts.

Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and platforms.
• Develop and optimize ETL/ELT processes to efficiently ingest, transform, and prepare data for AI/ML model training and analysis.
• Implement data quality checks and monitoring systems to ensure accuracy and integrity of data.
• Collaborate with data scientists and ML engineers to understand their data needs and provide solutions.
• Manage and optimize data storage solutions, ensuring cost-effectiveness and performance.

Skills

SQL proficiency

Python or Java

Big data technologies

Cloud data services

Data warehousing concepts

3+ years experience

Education

Bachelor's degree in CS/Engineering or related

Tools

Spark

Hadoop

Job description

Placements24 is seeking a dedicated Data Engineer in Centurion to build and optimize scalable data pipelines for AI platforms. You will ensure data availability, reliability, and performance for ML initiatives, handling large-scale datasets with modern tools.

The role requires 3+ years of data engineering experience, strong SQL, Python/Java skills, and familiarity with Spark/Hadoop and cloud data services. On-site work in Centurion offers opportunities for career growth and advanced data tooling