Data Engineer

Communicate IT; Centurion; On-site; ZAR 40 000 - 80 000; Full time

Job summary

An innovative firm is seeking a detail-oriented Data Engineer to enhance data utilization across its operations. This role involves designing and implementing scalable data pipelines, managing data storage with AWS S3, and optimizing queries using AWS Athena. Collaborating with analysts and engineers, you will ensure data quality and security while delivering meaningful insights. If you are passionate about building efficient data solutions in a dynamic environment, this opportunity is perfect for you to make a significant impact in the data landscape.

Qualifications

• Solid experience in a Data Engineering role, particularly in cloud-native environments.
• Strong proficiency in AWS tools, especially S3 and Athena.

Responsibilities

• Design and implement robust, scalable data pipelines and architectures.
• Manage and optimize data storage using AWS S3 and create queries with AWS Athena.

Skills

Data Engineering

AWS S3

AWS Athena

Python

ETL Processes

Data Modeling

Education

Bachelor's degree in Computer Science

Bachelor's degree in Information Technology

Tools

Apache Hive

Hadoop

Redshift

Spark

Apache Pig

NoSQL

Big Data

Data Warehouse

Kafka

Scala

Job description

Data Engineer Position - Johannesburg

We are seeking a driven and detail-oriented Data Engineer to join our client's team in Johannesburg. If you're passionate about building scalable data pipelines, working with AWS tools like S3 and Athena, and want to play a key role in shaping data utilization across a business, this could be your next move.

Duties & Responsibilities

1. Designing and implementing robust, scalable data pipelines and architectures
2. Managing and optimizing data storage using AWS S3
3. Creating and tuning queries using AWS Athena
4. Collaborating with analysts, engineers, and stakeholders to understand data needs and deliver meaningful insights
5. Ensuring data quality, reliability, and security at all times

Skills & Experience

• Solid experience in a Data Engineering role (bonus if you've worked in a cloud-native environment)
• Strong proficiency in AWS, particularly S3 and Athena
• Familiarity with Python or other scripting languages
• Good understanding of data modeling, ETL processes, and query optimization

Qualifications

Bachelor's degree in Computer Science, Information Technology, or a related field.

Application Process

Contact CARLIN FISHER quoting Ref: CTI005172.

Connect with us and register your CV to create a profile or view all our jobs in Information Technology. We are one of the leading Developer Recruitment Agencies in Cape Town.

Let us assist you with your IT career. We have openings for C# Developers, C Developers, Java Developers, .NET Developers, Angular Developers, and Full Stack Developers.

Package & Remuneration

Annual salary package.

Key Skills

Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala