Senior Data Engineer — Hybrid, Spark & Data Pipelines

Sasso Consulting (Pty) Ltd; Johannesburg; Hybrid; ZAR 900,000 - 1,200,000; Full time

Benefits offered by this job

Competitive salary

Medical, dental, and vision benefits

Retirement savings plan with employer

Training and professional development

Hybrid work environment

Job summary

Sasso Consulting (Pty) Ltd in Randburg is seeking a Senior Data Engineer to design, build and maintain scalable data pipelines and infrastructure for analytics and BI. You will work with large datasets and modern big data tech to transform raw data into actionable insights.

The role emphasizes data quality, security, collaboration with data scientists and stakeholders, and opportunities for professional development in a hybrid work environment.

Qualifications

• Bachelor's or Master's in Computer Science, Engineering, Statistics, or related field.
• 5+ years of experience in data engineering or related role.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Hands-on experience with big data technologies such as Apache Spark, Hadoop, Kafka or similar.
• Strong programming skills in Python or Scala.
• Experience with cloud platforms and data warehousing solutions.

Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and pipelines.
• Develop and implement ETL/ELT processes to ingest, transform, and load data into data warehouses and data lakes.
• Optimize data retrieval and processing for performance and cost-efficiency using big data technologies like Spark and Hadoop.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
• Ensure data quality, integrity, and security across all data systems.
• Build and maintain data models that support reporting, analytics, and machine learning applications.

Skills

SQL

Python

Scala

Data modeling

Data integration

Education

Bachelor's or Master's in CS/Engineering/Statistics

Tools

Apache Spark

Hadoop

Kafka

Job description

Sasso Consulting (Pty) Ltd in Randburg is seeking a Senior Data Engineer to design, build and maintain scalable data pipelines and infrastructure for analytics and BI. You will work with large datasets and modern big data tech to transform raw data into actionable insights.

The role emphasizes data quality, security, collaboration with data scientists and stakeholders, and opportunities for professional development in a hybrid work environment.