Data Engineer: Cloud Data Ecosystem & Pipelines

Mintek Pty Ltd.; Randburg; On-site; ZAR 520,000 - 780,000; Full time

Job summary

Mintek Pty Ltd. invites a data engineer to develop its data ecosystem and collaborate with the software team to deploy new cloud services for internal use and for the South African and global minerals and metals industries.

You will build and maintain data pipelines, manage storage and catalogs, automate data workflows, and monitor operations while partnering with scientists, engineers and operators to ensure timely, budget-conscious delivery.

Qualifications

• BSc Hons or 4-year BEng degree is required.
• MSc or MEng in CS, engineering, mathematics, statistics, physics or related field preferred.

Responsibilities

• Build and maintain the data ecosystem within Mintek.
• Develop and maintain ETL pipelines and automate data workflows.
• Maintain storage systems and data catalogs.
• Execute data operations, orchestration and monitoring.
• Engage with scientists, engineers and operators to integrate with upstream/downstream layers.
• Ensure projects are executed on time and within budget.
• Participate in team debates and technical decisions.
• Produce professional reports and product documentation.
• Conceptualise, design, execute, analyse and troubleshoot independently.
• Adhere to SHEQ procedures and ensure technical efficiency.
• Identify opportunities for technology development and commercialisation.
• Keep up-to-date with technology and business developments relevant to the division.

Skills

SQL

Python

Azure

Java

Education

B.Sc Hons

B.Eng degree (4-year)

M.Sc or M.Eng (preferred)

Tools

Git

Microsoft Project

Trello

Microsoft Planner

Job description

Mintek Pty Ltd. invites a data engineer to develop its data ecosystem and collaborate with the software team to deploy new cloud services for internal use and for the South African and global minerals and metals industries.

You will build and maintain data pipelines, manage storage and catalogs, automate data workflows, and monitor operations while partnering with scientists, engineers and operators to ensure timely, budget-conscious delivery.