Senior Data Engineer: Scalable Pipelines & Analytics

4Sight Business Environment; Gauteng; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A consulting and IT firm in South Africa seeks a Data Engineer responsible for designing and maintaining data infrastructure. The candidate will work with cross-functional teams to develop solutions that meet data needs. Required qualifications include a Bachelor's degree in Computer Science and at least 5 years in data engineering, along with skills in Python, SQL, and big data technologies. Collaboration and problem-solving are essential for this full-time role.

Qualifications

• 5 years or more experience in data engineering or related roles.
• Strong SQL skills with both relational and NoSQL databases.
• Familiarity with cloud platforms like Azure.

Responsibilities

• Design and maintain scalable and efficient data pipelines.
• Collaborate with clients to interpret business requirements.
• Implement data quality and governance processes.

Skills

Python

R

Hadoop

Spark

Kafka

SQL

Azure

Problem-solving

Communication

Collaboration

Education

Bachelor's degree in Computer Science

Master's degree

Tools

Docker

Kubernetes

QlikView

Power BI

Apache NiFi

Job description

A consulting and IT firm in South Africa seeks a Data Engineer responsible for designing and maintaining data infrastructure. The candidate will work with cross-functional teams to develop solutions that meet data needs. Required qualifications include a Bachelor's degree in Computer Science and at least 5 years in data engineering, along with skills in Python, SQL, and big data technologies. Collaboration and problem-solving are essential for this full-time role.