SENIOR CLOUD DATA ENGINEER

Liquid Thought; Johannesburg; On-site; ZAR 900,000 - 1,500,000; Full time

Job summary

Liquid Thought is seeking a Senior Cloud Data Engineer to join our Gauteng-based team. You will design and implement data pipelines on Google Cloud, leveraging BigQuery and Dataproc, while building scalable RESTful services and robust data models.

You will transform unstructured data into meaningful stories and visuals, enabling leadership to make informed, data-driven decisions. A strong emphasis on collaboration with data scientists and product teams is required.

Qualifications

• Honours level software engineering degree (Masters advantageous).
• 5+ years development experience with Python.
• Strong data skills with SQL and NoSQL.
• Experience with large-scale ETL processes.
• Experience building high-scale RESTful services.
• Cloud experience, ideally Google Cloud Platform.
• Experience using source control (Git).

Responsibilities

• Work primarily within a Google Cloud environment using BigQuery, Dataproc, Kubernetes and AI Hub.
• Transform messy, unstructured data into actionable insights and visuals for decision-makers.
• Collaborate with data scientists, engineers and product teams to deliver scalable data solutions.

Skills

Python

SQL

NoSQL

ETL

RESTful services

Google Cloud Platform

Git

Data visualization

Education

Honours degree in Software Engineering (Masters advantageous)

Tools

Kubernetes

Docker

Airflow/Composer

BigQuery

Dataproc

Elasticsearch

Apache Beam

Apache Spark

Job description

Location: CT/JHB

Our client, a well-known South African media and technology company, is looking for a Senior Cloud Data Engineer to join their team. This organisation is behind some of the country's most recognisable digital news and information brands, and its in-house team of engineers, data scientists, product managers and UX/UI designers builds the digital products that keep millions of South Africans informed, entertained and inspired every day.

Why join this team?

You’ll be joining a people-focused, innovation-driven engineering culture that uses a sophisticated, modern tech stack to deliver world-class digital solutions. This is a business with a strong societal mission, and the data engineering team plays a central role in turning raw data into the stories and insights that help decision-makers steer the business forward.

What will you do?

You’ll work primarily within a Google Cloud environment, using tools across the Google stack, from BigQuery and Dataproc to Kubernetes and AI Hub. You should be comfortable thinking in Python and speaking fluent SQL, and you shouldn’t be afraid to dive into messy, unstructured data and help the wider team make sense of it. Ultimately, you’ll be helping transform data into the stories and visuals that drive real business decisions.

What You’ll Need

• A relevant software engineering degree, at least at Honours level (a Masters would be advantageous)
• 5+ years of development experience working with Python
• Strong data skills, including both traditional SQL and NoSQL
• Experience with large-scale ETL processes
• Experience building high-scale RESTful services
• Cloud experience, ideally with Google Cloud Platform
• Experience using source control (Git)

Beneficial skills

• Scheduling and orchestration (Airflow/Composer)
• Containerisation (Kubernetes, Docker)
• BigQuery
• Elasticsearch
• Data warehousing concepts
• Data governance concepts
• Apache Beam (Cloud Dataflow)
• Apache Spark (Dataproc)

What’s in it for you?

• AI-forward culture: this organisation actively looks for ways to leverage AI to unlock new opportunities, and encourages its teams to explore and experiment with cutting-edge tools to boost productivity and results.
• Continuous learning and growth: benefit from a wealth of learning opportunities, including free access to platforms like Udemy, the chance to pursue nanodegrees, complimentary Microsoft certification training, and bursary opportunities, all backed by a major listed parent group.
• Stay ahead: attend leading tech events and expos to keep up with industry trends and innovation.
• Personalised benefits: choose from optional medical aid and customisable retirement funding options to suit your needs.
• Give back: take up to 3 days of paid volunteering leave each year to support causes you care about.

This role is being handled on an exclusive basis by our agency on behalf of our client, whose identity will be shared with shortlisted candidates. In line with our client’s employment equity policy, preference will be given to suitable candidates from designated groups.

As we receive a high volume of applications, we are unfortunately not able to respond individually to every candidate. If you have not heard from us within one month, please take this as confirmation that your application was not successful on this occasion.