Data Engineer: AI Platforms & Scalable Pipelines

Placements24; Upington; In loco; ZAR 600.000 - 900.000; Tempo pieno

Vantaggi offerti da questo lavoro

Competitive salary

Medical aid

Retirement plan

Professional growth

Generous paid time off

Descrizione del lavoro

Placements24 is seeking a Data Engineer to design, develop, and maintain robust data platforms in Upington to power AI initiatives. The role focuses on building scalable data pipelines for ML and analytics and ensuring data quality and accessibility for data science teams.

You will work with Spark/Hadoop, SQL, Python or Scala, and cloud data services to support data warehousing and data lakes, enabling reliable insights and AI workloads. This position is based on-site in Upington, South Africa.

Competenze

• Bachelor's degree in CS, Engineering or related field.
• 3-5 years of data engineering experience.
• Proficient in SQL and programming (Python or Scala).
• Experience with Spark/Hadoop and cloud data services.

Mansioni

• Design, construct, install, test, and maintain highly scalable data management systems.
• Develop and optimize data pipelines for ETL.
• Collaborate with data scientists and AI engineers to understand data needs.
• Ensure data quality, integrity, and security across platforms.
• Implement data warehousing and data lakes for analytical workloads.
• Monitor and troubleshoot data infrastructure for performance and availability.

Conoscenze

SQL

Python

Scala

Big Data

Cloud Data Services

Formazione

Bachelor's degree in CS/Engineering

Strumenti

Spark

Hadoop

AWS S3

BigQuery

Descrizione del lavoro

Placements24 is seeking a Data Engineer to design, develop, and maintain robust data platforms in Upington to power AI initiatives. The role focuses on building scalable data pipelines for ML and analytics and ensuring data quality and accessibility for data science teams.

You will work with Spark/Hadoop, SQL, Python or Scala, and cloud data services to support data warehousing and data lakes, enabling reliable insights and AI workloads. This position is based on-site in Upington, South Africa.