Senior Data Engineer: Cloud & Big Data Pipelines

Araxi Group; Johannesburg; On-site; ZAR 800,000 - 1,100,000; Full time

Benefits offered by this job

Competitive salary

Professional growth opportunities

Modern cloud & big data platforms

Job summary

Araxi Group is seeking a Data Engineer to build, support, and optimise scalable data pipelines and analytics platforms. You will join an agile team to enable insights through data integration, transformation, and management of large-scale batch and real-time solutions in a cloud-first environment.

The role emphasizes Python data processing, AWS EMR/S3, Spark/Hadoop, and CI/CD for data platforms, with opportunities for professional growth in a collaborative setting.

Qualifications

• 5+ years’ experience in Data Engineering or Software Engineering.
• 2+ years’ experience with Big Data technologies and platforms.
• 2+ years’ experience with ETL processes and tooling.
• 2+ years’ experience with AWS cloud technologies.
• Strong experience with Python for data manipulation.
• Hands-on AWS services including EMR, EC2, S3.
• Experience with PySpark, Spark, Hadoop or similar.

Responsibilities

• Design, build, and maintain scalable data analytics frameworks and data platforms.
• Translate complex requirements into scalable architecture and data solutions.
• Develop batch and real-time data processing using modern big data tech.
• Create secure data pipelines between on-premise systems and AWS.
• Develop ETL processes and data transformation workflows.
• Manipulate, process, and analyse data using Python.
• Support Big Data/BI solutions with automated testing and deployment.
• Process large datasets using Hadoop paradigms and AWS EMR.

Skills

Data engineering

Python programming

Analytical thinking

Problem solving

Stakeholder communication

Education

Bachelor’s degree in Computer Science / IT / related field

AWS Certification (advantageous)

Tools

AWS

PySpark

Spark

Hadoop

Talend

Job description

Araxi Group is seeking a Data Engineer to build, support, and optimise scalable data pipelines and analytics platforms. You will join an agile team to enable insights through data integration, transformation, and management of large-scale batch and real-time solutions in a cloud-first environment.

The role emphasizes Python data processing, AWS EMR/S3, Spark/Hadoop, and CI/CD for data platforms, with opportunities for professional growth in a collaborative setting.