Data Engineer

4Sight Business Environment; Gauteng; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A consulting and IT firm in South Africa seeks a Data Engineer responsible for designing and maintaining data infrastructure. The candidate will work with cross-functional teams to develop solutions that meet data needs. Required qualifications include a Bachelor's degree in Computer Science and at least 5 years in data engineering, along with skills in Python, SQL, and big data technologies. Collaboration and problem-solving are essential for this full-time role.

Qualifications

• 5 years or more experience in data engineering or related roles.
• Strong SQL skills with both relational and NoSQL databases.
• Familiarity with cloud platforms like Azure.

Responsibilities

• Design and maintain scalable and efficient data pipelines.
• Collaborate with clients to interpret business requirements.
• Implement data quality and governance processes.

Skills

Python

R

Hadoop

Spark

Kafka

SQL

Azure

Problem-solving

Communication

Collaboration

Education

Bachelor's degree in Computer Science

Master's degree

Tools

Docker

Kubernetes

QlikView

Power BI

Apache NiFi

Job description

Group Recruitment Specialist at 4Sight Holdings Limited

Job Description :

As a Data Engineer you will be responsible for designing, developing, and maintaining data infrastructure and architecture.

You will work closely with cross‑functional teams to understand their data requirements and implement solutions to support various business initiatives.

The ideal candidate will have a strong background in software engineering, database management, and data processing technologies.

Responsibilities

Engage with clients to interpret business requirements and relay the requirements into a design and then a deliverable.

Design, build, and maintain scalable and efficient data pipelines to collect, process, and store large volumes of structured and unstructured data.

Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and requirements.

Develop data models and schemas to support business reporting and analytics.

Optimise and tune database queries and processes for improved performance and reliability.

Implement data quality and governance processes to ensure accuracy, completeness, and consistency of data.

Stay current with industry trends and best practices in data engineering and recommend new technologies and approaches as needed.

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred

5 Years or more experience in data engineering or related roles

Proficiency in programming languages such as Python, R, etc.

Experience with big data technologies such as Hadoop, Spark, Kafka, etc.

Strong SQL skills and experience with relational and NoSQL databases

Familiarity with cloud platforms such as Azure

Understand project management principles

Excellent problem‑solving and analytical skills

Strong communication and collaboration skills

Preferred Qualifications

Experience with containerisation and orchestration technologies such as Docker, Kubernetes, etc.

Knowledge of machine learning and data science concepts

Experience with data processing frameworks such as NiFi, Apache Kafka, etc.

Familiarity with data visualization tools such as QlikView, Power BI, etc.

Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

Consulting, IT Services and IT Consulting and Data Infrastructure and Analytics