Senior Data Engineer - AI/ML Pipelines, Hybrid

Liyema Consulting Group; Johannesburg; Ibrido; ZAR 600.000 - 1.000.000; Tempo pieno

Vantaggi offerti da questo lavoro

Competitive salary bonuses

Health and retirement benefits

Professional development opportunities

Cutting-edge data infra

Sandton location

Descrizione del lavoro

Liyema Consulting Group in Randburg is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support analytics and BI initiatives. You will work with data scientists and ML engineers, optimize data ingestion and storage, and contribute to data warehousing on cloud platforms.

This permanent, hybrid role offers a competitive salary, ongoing professional development, and the opportunity to work on cutting-edge data infrastructure in a dynamic

Competenze

• Bachelor's or Master's degree in CS/Engineering or related field.
• 5+ years of data engineering experience with exposure to AI/ML projects.
• Proficiency in SQL; Python or Scala programming.
• Experience with Spark, Hadoop, and cloud data platforms (AWS/Azure/GCP).
• Strong data modeling, ETL/ELT, and data warehousing fundamentals.

Mansioni

• Design, build, and maintain scalable data pipelines for AI/ML applications.
• Optimize data ingestion, transformation, and storage for efficiency and performance.
• Implement data quality checks and monitoring systems to ensure data accuracy and integrity.
• Collaborate with data scientists and ML engineers to understand data needs and provide solutions.
• Develop and manage data warehousing solutions and big data platforms.

Conoscenze

Data engineering experience

SQL

Python

Scala

Spark/Hadoop

Cloud platforms (AWS, Azure, GCP)

Data modeling & ETL/ELT

Formazione

Bachelor's or Master's degree in CS/Engineering

Strumenti

Spark

Hadoop

AWS

Azure

GCP

Descrizione del lavoro

Liyema Consulting Group in Randburg is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support analytics and BI initiatives. You will work with data scientists and ML engineers, optimize data ingestion and storage, and contribute to data warehousing on cloud platforms.

This permanent, hybrid role offers a competitive salary, ongoing professional development, and the opportunity to work on cutting-edge data infrastructure in a dynamic