Data Engineer - AI/ML Platforms

Placements24; Paarl; On-site; ZAR 650,000 - 950,000; Full time

Benefits offered by this job

Competitive salary

Modern data stack

Development opportunities

AI-focused team

Collaborative culture

Job summary

Placements24 in Paarl is seeking a skilled Data Engineer to build and maintain robust data pipelines and infrastructure supporting AI/ML initiatives on-site.

You will design scalable ETL/ELT processes, optimize data storage, and collaborate with data scientists to provide clean, structured data for model development. A Bachelor's degree and 3+ years in data engineering are required.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related quantitative field.
• 3+ years of data engineering experience with big data technologies.
• Proficiency in SQL and data warehousing concepts.
• Experience with cloud platforms (AWS, Azure, GCP) and data services.
• Strong programming skills in Python or Scala.
• Familiarity with Spark, Hadoop, and related tools.

Responsibilities

• Design, build, and maintain scalable data pipelines for AI/ML workloads.
• Develop ETL/ELT processes to ingest, transform, and store data from various sources.
• Optimize data infrastructure for performance, cost, and reliability.
• Collaborate with data scientists and ML engineers to provide clean data for models.
• Implement data quality checks and monitoring to ensure data integrity.
• Manage data warehousing solutions and data lakes.

Skills

SQL proficiency

Python or Scala

Analytical thinking

Team collaboration

Education

Bachelor's degree in CS/Engineering or related

Tools

Apache Spark

Apache Hadoop

AWS/Azure/GCP

Data warehousing concepts

ETL/ELT tooling

Job description

About the Role

Our client is seeking a highly skilled Data Engineer to build and maintain robust data pipelines and infrastructure supporting their AI and Machine Learning initiatives in Paarl . This role is critical in ensuring that data is accessible, reliable, and optimized for AI model training and deployment. You will work closely with data scientists and ML engineers to understand their data needs and provide high-quality data solutions. This on-site position offers the opportunity to work with cutting-edge data technologies and contribute significantly to the company's data-driven strategy within a collaborative environment.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for AI/ML workloads.
• Develop ETL/ELT processes to ingest, transform, and store data from various sources.
• Optimize data infrastructure for performance, efficiency, and cost-effectiveness.
• Collaborate with data scientists and ML engineers to provide clean, structured data for model development.
• Implement data quality checks and monitoring to ensure data accuracy and integrity.
• Manage and maintain data warehousing solutions and data lakes.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 3+ years of experience in data engineering, with a focus on big data technologies.
• Proficiency in SQL and experience with data warehousing concepts.
• Experience with cloud platforms (AWS, Azure, GCP) and their data services.
• Strong programming skills in Python or Scala.
• Familiarity with big data frameworks like Spark, Hadoop, and related tools.
• Understanding of the challenges and requirements for AI/ML data pipelines.

Benefits

• Competitive salary and comprehensive benefits package.
• Opportunity to work with modern data stack and AI technologies.
• Professional development and training opportunities.
• Be part of a key team supporting AI advancements in Paarl .
• Work in a collaborative and innovative company culture.