Data Engineer - AI Platforms

Placements24; Upington; On-site; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Competitive salary

Medical aid

Retirement plan

Professional growth

Generous paid time off

Job summary

Placements24 is seeking a Data Engineer to design, develop, and maintain robust data platforms in Upington to power AI initiatives. The role focuses on building scalable data pipelines for ML and analytics and ensuring data quality and accessibility for data science teams.

You will work with Spark/Hadoop, SQL, Python or Scala, and cloud data services to support data warehousing and data lakes, enabling reliable insights and AI workloads. This position is based on-site in Upington, South Africa.

Qualifications

• Bachelor's degree in CS, Engineering or related field.
• 3-5 years of data engineering experience.
• Proficient in SQL and programming (Python or Scala).
• Experience with Spark/Hadoop and cloud data services.

Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems.
• Develop and optimize data pipelines for ETL.
• Collaborate with data scientists and AI engineers to understand data needs.
• Ensure data quality, integrity, and security across platforms.
• Implement data warehousing and data lakes for analytical workloads.
• Monitor and troubleshoot data infrastructure for performance and availability.

Skills

SQL

Python

Scala

Big Data

Cloud Data Services

Education

Bachelor's degree in CS/Engineering

Tools

Spark

Hadoop

AWS S3

BigQuery

Job description

About the Role

Our client is seeking a skilled Data Engineer to join their team, focusing on building and maintaining robust data platforms that power their artificial intelligence initiatives in Upington . You will be responsible for designing, developing, and optimizing data pipelines that ingest, transform, and store large volumes of data required for machine learning and analytics. This role is critical for ensuring data availability, quality, and accessibility for our data science and AI teams, enabling them to build and deploy cutting-edge solutions.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems.
• Develop and optimize data pipelines for efficient data extraction, transformation, and loading (ETL).
• Collaborate with data scientists and AI engineers to understand their data needs and provide reliable data solutions.
• Ensure data quality, integrity, and security across all data platforms.
• Implement data warehousing solutions and data lakes to support analytical and AI workloads.
• Monitor and troubleshoot data infrastructure to ensure optimal performance and availability.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 3-5 years of experience in data engineering or a similar role.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Strong programming skills in Python or Scala.
• Experience with big data technologies such as Spark, Hadoop, or similar frameworks.
• Familiarity with cloud data services (e.g., AWS Redshift, S3, Azure Data Lake, Google BigQuery).

Benefits

• Competitive salary and annual bonus opportunities.
• Comprehensive medical aid and retirement fund benefits.
• Opportunities for professional growth and learning new data technologies.
• A supportive team environment focused on data innovation.
• Generous paid time off and company holidays.