Senior Data Engineer - AI/ML Pipelines, Hybrid

Liyema Consulting Group; Johannesburg; Hybrid; ZAR 600,000 - 1,000,000; Full time

Benefits offered by this job

Competitive salary bonuses

Health and retirement benefits

Professional development opportunities

Cutting-edge data infra

Sandton location

Job summary

Liyema Consulting Group in Randburg is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support analytics and BI initiatives. You will work with data scientists and ML engineers, optimize data ingestion and storage, and contribute to data warehousing on cloud platforms.

This permanent, hybrid role offers a competitive salary, ongoing professional development, and the opportunity to work on cutting-edge data infrastructure in a dynamic

Qualifications

• Bachelor's or Master's degree in CS/Engineering or related field.
• 5+ years of data engineering experience with exposure to AI/ML projects.
• Proficiency in SQL; Python or Scala programming.
• Experience with Spark, Hadoop, and cloud data platforms (AWS/Azure/GCP).
• Strong data modeling, ETL/ELT, and data warehousing fundamentals.

Responsibilities

• Design, build, and maintain scalable data pipelines for AI/ML applications.
• Optimize data ingestion, transformation, and storage for efficiency and performance.
• Implement data quality checks and monitoring systems to ensure data accuracy and integrity.
• Collaborate with data scientists and ML engineers to understand data needs and provide solutions.
• Develop and manage data warehousing solutions and big data platforms.

Skills

Data engineering experience

SQL

Python

Scala

Spark/Hadoop

Cloud platforms (AWS, Azure, GCP)

Data modeling & ETL/ELT

Education

Bachelor's or Master's degree in CS/Engineering

Tools

Spark

Hadoop

AWS

Azure

GCP

Job description

Liyema Consulting Group in Randburg is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support analytics and BI initiatives. You will work with data scientists and ML engineers, optimize data ingestion and storage, and contribute to data warehousing on cloud platforms.

This permanent, hybrid role offers a competitive salary, ongoing professional development, and the opportunity to work on cutting-edge data infrastructure in a dynamic