AI Data Engineer: Build Scalable AI Pipelines

Praesignis; South Africa; Hybrid; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Hybrid work model

Professional development

Medical aid

Retirement benefits

Career growth in AI/data tech

Job summary

Praesignis seeks an experienced AI Data Engineer to build and maintain scalable data pipelines powering AI initiatives in Soweto. You will design, implement, and optimize ETL/ELT processes, ensure data quality and security, and collaborate with data scientists and ML engineers to deliver reliable data services.

The role emphasizes multi-tenant data isolation, governance and integration with REST/SOAP APIs, SQL, Python and PySpark, using Microsoft Fabric and cloud platforms.

Qualifications

• Bachelor's degree or equivalent in a quantitative field.
• 3+ years of data engineering experience with big data.
• Proficient in Python/SQL/Scala and ETL/ELT.
• Experience with Spark/Hadoop and cloud data services.
• Strong data modeling and architecture knowledge.
• Azure Fabric and/or Azure data certifications preferred.
• Hands-on with Microsoft Fabric components (OneLake, Lakehouse, Warehouse, Data Pipelines, notebooks).
• CI/CD with Git/Azure DevOps and data governance awareness.
• Power BI support experience and data reporting.
• Excellent documentation and stakeholder communication skills.

Responsibilities

• Design and build scalable ETL/ELT pipelines for AI/ML workloads.
• Maintain data quality, security, and availability across platforms.
• Develop Data Platform APIs for ingestion, processing, and access.
• Collaborate with data scientists and engineers to meet data requirements.
• Monitor pipelines, resolve failures, and optimize performance.
• Ensure multi-tenant data isolation and proper governance.

Skills

3+ years experience

Python

SQL

Scala

data modeling

data architecture

Power BI

data transformation

Education

Bachelor's degree in CS/Engineering/Statistics

Microsoft Fabric Azure certification

Tools

Spark

Hadoop

Azure

OneLake

Lakehouse

Data Factory

SQL Server/T-SQL

REST/SOAP APIs

Job description

Praesignis seeks an experienced AI Data Engineer to build and maintain scalable data pipelines powering AI initiatives in Soweto. You will design, implement, and optimize ETL/ELT processes, ensure data quality and security, and collaborate with data scientists and ML engineers to deliver reliable data services.

The role emphasizes multi-tenant data isolation, governance and integration with REST/SOAP APIs, SQL, Python and PySpark, using Microsoft Fabric and cloud platforms.