Data Engineer

Arcs; Gauteng; On-site; ZAR 40 000 - 80 000; Full time

Job summary

An established industry player is seeking a proactive Data Engineer to enhance its data infrastructure. This pivotal role involves developing robust data pipelines and conducting in-depth analysis to produce actionable insights. The ideal candidate will champion a data-driven culture, explore emerging technologies, and collaborate with stakeholders to ensure the data ecosystem evolves and delivers value. With a focus on cloud-first solutions and advanced analytics, this opportunity offers a dynamic environment for those passionate about data engineering and innovation.

Qualifications

• 5 - 10 years' experience as a Data Engineer with strong programming skills.
• Good database design skills and understanding of data warehousing techniques.

Responsibilities

• Develop and maintain data pipelines for reliable data delivery.
• Conduct data analysis and create actionable reports for decision-making.

Skills

Python

SQL

Data Analysis

Data Warehousing

Machine Learning

Education

Relevant IT Degree

Diploma or Certification

Tools

Microsoft SQL Server

Oracle

MongoDB

Amazon S3

Microsoft Power BI

Git

GitLab

Job description

We are seeking a highly skilled and proactive Data Engineer to join our team and play a pivotal role in shaping and supporting our data infrastructure.This position is responsible for developing and maintaining robust data pipelines that enable reliable, scalable data delivery across the organization.

The successful candidate will also conduct in-depth data analysis and produce clear, actionable reports to inform decision-making.

Beyond core engineering tasks, this role will champion a data-driven culture, explore emerging technologies, and collaborate closely with stakeholders to ensure our data ecosystem continues to evolve and deliver value.This role is a 3 year contract with the option to renew.Duties & Responsibilities : There are two main duties : Develop & maintain data pipelines in support of downstream data delivery.Perform analysis on organisational data & create reports to communicate the results.Other potential duties include, but are not limited to : Communicate and advocate for a data-driven mindset in the larger organisational community, especially the IT department.Investigate and evaluate emerging technologies like robotic process automation (RPA), new AWS services, new data management approaches, machine learning advancements, etc.Liaise with individuals in the organisation in support of all the above duties.Qualifications & Experience : Relevant IT degree, Diploma or certification5 - 10 years' experience as a Data EngineerGood programming skills in both Python and SQL.Good database design skills and an understanding of data warehousing techniques and approaches.An understanding of and ability to access data from sources such as : Microsoft SQL Server, Oracle, MongoDB, Amazon S3Windows and Linux file systems (Excel, delimited files, etc.

HTTP APIsSFTP sitesAn ability to engineer cloud-first solutions in the Amazon Web Services cloud.An interest in machine learning and advanced analytics, and the development of data pipelines insupport thereof.An understanding of the software development process, with proficiency in Git for version control and build & deployment pipelines in GitLab.An ability to create reports and BI dashboards to communicate data & analysis results, using a variety of technologies, which might include : Microsoft SQL Server Reporting Services, Microsoft Power BI, Microsoft Excel