AI Data Engineer — ETL, Snowflake & Python

Communicate Finance; South Africa; Hybrid; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Communicate Finance in South Africa is seeking an experienced Data Engineer in Soweto to design, build, and maintain scalable data pipelines for AI/ML workloads. You will develop ETL/ELT processes to ingest, transform, and load data from APIs, databases, and other sources, while ensuring data quality, security, and governance.

The role requires a strong background in data engineering, big data technologies, and cloud data services, with emphasis on PII handling and regulatory compliance.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 3+ years of experience in data engineering, with big data focus.
• Proficiency in Python and SQL, and data processing concepts.

Responsibilities

• Design, build, and maintain scalable data pipelines for AI/ML workloads.
• Develop ETL/ELT processes to ingest, transform, and load data from diverse sources.
• Ensure data quality, integrity, and security across platforms.

Skills

Python

SQL

Data Warehouse

Databases

Cloud

Analytics

Data modelling

ETL/ELT

Data Pipeline Development

CI/CD

Education

Bachelor's degree in Computer Science or Engineering

Tools

Spark

Hadoop

Azure/AWS/GCP

Microsoft Fabric

Job description

Communicate Finance in South Africa is seeking an experienced Data Engineer in Soweto to design, build, and maintain scalable data pipelines for AI/ML workloads. You will develop ETL/ELT processes to ingest, transform, and load data from APIs, databases, and other sources, while ensuring data quality, security, and governance.

The role requires a strong background in data engineering, big data technologies, and cloud data services, with emphasis on PII handling and regulatory compliance.