Senior Data Engineer: Scalable Pipelines & Cloud

Tenth Revolution Group; Gauteng; On-site; ZAR 900,000 - 1,300,000; Full time

Job summary

Tenth Revolution Group seeks a Data Engineer to build and support scalable data pipelines, enabling insights from vast datasets. You will shape the infrastructure for batch and real-time processing, integrating diverse data sources and ensuring security and repeatability within an agile team.

The role involves designing data analytics frameworks, leading technical implementations, and developing Big Data/BI solutions with tools like Talend and Hadoop EMR within an on-prem to AWS Cloud context.

Qualifications

• Bachelor’s degree or equivalent in CS/Engineering.
• AWS Certification is strongly preferred.
• Proficient in multiple programming/scripting languages.
• Strong data modelling knowledge and understanding of data structures.

Responsibilities

• Architect data analytics framework and translate requirements into architecture.
• Lead data and batch/real-time analytical solutions using modern technologies.
• Develop data pipelines for on-premise to AWS Cloud and maintain data feeds in production.
• Create data marts and enable Big Data/BI solutions with automated testing and deployment.

Skills

Programming languages

Data modelling

Distributed systems design

Analytical thinking

Education

Bachelor’s Degree in Computer Science/Engineering or equivalent

AWS Certification

Tools

Talend

Hadoop (EMR)

ETL tools

AWS services

Job description

Tenth Revolution Group seeks a Data Engineer to build and support scalable data pipelines, enabling insights from vast datasets. You will shape the infrastructure for batch and real-time processing, integrating diverse data sources and ensuring security and repeatability within an agile team.

The role involves designing data analytics frameworks, leading technical implementations, and developing Big Data/BI solutions with tools like Talend and Hadoop EMR within an on-prem to AWS Cloud context.