Senior Data Engineer — Remote AI Data Pipelines Lead

Placements24; Vereeniging; Hybrid; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Competitive salary

Health benefits

Professional development opportunities

Job summary

Placements24 seeks a Senior Data Engineer to build and maintain scalable data pipelines and infrastructure for AI platforms. This fully remote role can be performed from anywhere, including Vereeniging, Gauteng, SA, and will collaborate with data scientists to support ML initiatives.

The ideal candidate has experience with Spark, Hadoop, Kafka, and cloud data services, plus strong SQL and programming skills. Excellent collaboration in a remote team is essential.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, IT, or related field.
• Proven experience building large-scale data pipelines.
• Experience with cloud data platforms and data warehousing concepts.

Responsibilities

• Design, build, test, and maintain scalable data pipelines and infrastructure.
• Develop and optimize ETL/ELT processes for ML and analytics.
• Manage data lakes/warehouses ensuring quality and accessibility.
• Collaborate with data scientists and AI engineers on data needs.
• Implement data governance and security practices.
• Monitor pipelines, troubleshoot, and improve performance.
• Automate data processes and CI/CD tooling; evaluate new tech.

Skills

SQL

Python

Scala

Java

Data Pipelines

Data Modeling

Distributed Systems

CI/CD

Education

Bachelor's or Master's degree in CS/Engineering/IT

Tools

Apache Spark

Hadoop

Kafka

S3

Redshift

BigQuery

Databricks

Job description

Placements24 seeks a Senior Data Engineer to build and maintain scalable data pipelines and infrastructure for AI platforms. This fully remote role can be performed from anywhere, including Vereeniging, Gauteng, SA, and will collaborate with data scientists to support ML initiatives.

The ideal candidate has experience with Spark, Hadoop, Kafka, and cloud data services, plus strong SQL and programming skills. Excellent collaboration in a remote team is essential.