Senior Data Engineer - Ftc - Immediately Available

Job Specification

We are seeking a highly skilled Data Engineer with expertise in Python and SQL to develop and maintain data solutions for our client in the mining industry. The successful candidate will work with geologists, engineers, and data scientists to optimise data pipelines, process large datasets from IoT sensors and mining equipment, and support real-time analytics.

In order to be considered for this role, you must meet the following requirements:

• Matric
• BSc in engineering and/or sciences with demonstrable experience in machine learning. MSc degree is a plus.
• Microsoft Certification in SQL Development.

You must be an expert in:

Knowledge of ETL / ELT processes and tools

Experience designing and deploying code in cloud-based data platforms and agile environments.

Programming languages: Python & SQL (advanced)

Experience setting up and maintaining Azure cloud services: Azure Data Factory, Blob Storage & Databricks.

Big Data Knowledge is a plus: Spark, Hadoop, or MapReduce.

Experience in communication across systems (e.g. API).

Experience with sensor data ingestion and IoT data processing.

Strong understanding of geospatial data processing (GIS, PostGIS, QGIS, or ArcGIS).

Knowledge of real-time data streaming technologies for monitoring mining operations.

Ability to work with unstructured data from geological surveys, drone imagery, and seismic sensors.

Strong background in data warehousing concepts for mining analytics and reporting.

Experience with version control (Git) and CI/CD for data pipelines.

Key Responsibilities (not limited to):

Design, build, and maintain ETL / ELT pipelines to process data from mining equipment, IoT devices, and operational systems.

Develop and optimise SQL queries, stored procedures, and data models for efficient mining data analysis.

Write efficient Python scripts for data extraction, transformation, and integration from diverse sources.

Manage large-scale relational databases (PostgreSQL, MySQL, SQL Server) and NoSQL databases for unstructured geological and sensor data.

Work with real-time data streaming from mining equipment, GPS trackers, and environmental sensors using Kafka, Kinesis, or similar tools.

Ensure data quality, integrity, and governance for compliance with mining regulations and safety standards.

Collaborate with geologists, mining engineers, and operations teams to provide insights from data.

Implement predictive maintenance solutions by analyzing historical sensor and equipment data.

Work with GIS data and geospatial databases to support mine planning and exploration.

Deploy and maintain cloud-based data solutions (AWS, Azure, or GCP) for scalable data storage and processing.

WILL SUIT SOMEONE IMMEDIATELY AVAILABLE FOR A 6 MONTH CONTRACT WITH THE POSSIBILITY OF EXTENDING.

Should you meet ALL of the above requirements, please send your CV to [email address].

Disclaimer: Should you not hear from us within 2 weeks, please consider your application unsuccessful.

Required Experience:

Senior IC

Key Skills:

Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala.

Employment Type: Full-Time

Experience: years

Vacancy: 1