SENIOR CLOUD DATA ENGINEER

Liquid Thought; Johannesburg; On-site; ZAR 900,000 - 1,500,000; Full time

Benefits offered by this job

AI-forward culture

Learning opportunities (Udemy, nanodeg

Tech events & expos

Job summary

Liquid Thought is seeking a Senior Cloud Data Engineer in Johannesburg to join a high-performance data engineering team. You will work primarily in Google Cloud, turning unstructured data into actionable insights, APIs and scalable data services.

You will design and implement ETL pipelines, work with BigQuery, Dataproc, and Kubernetes, and collaborate with engineers, data scientists and product managers to deliver world-class digital experiences.

Qualifications

• A relevant software engineering degree, at least Honours level (Masters advantageous).
• 5+ years of development experience with Python.
• Strong data skills: SQL and NoSQL.
• Experience with large-scale ETL processes.
• Experience building high-scale RESTful services.
• Cloud experience, ideally Google Cloud Platform.
• Experience using source control (Git).

Responsibilities

• Work primarily within a Google Cloud environment across the Google stack.
• Transform raw data into stories and visuals to drive business decisions.
• Collaborate with data scientists, product managers and engineers to deliver data-driven solutions.

Skills

Python

SQL

NoSQL

ETL

RESTful services

Git

Education

Honours degree in software engineering

Tools

Google Cloud Platform

BigQuery

Dataproc

Kubernetes

Airflow

Composer

Docker

Job description

Location: CT/JHB Our client, a well-known South African media and technology company, is looking for a Senior Cloud Data Engineer to join their team. This organisation is behind some of the country's most recognisable digital news and information brands, and its in-house team of engineers, data scientists, product managers and UX/UI designers builds the digital products that keep millions of South Africans informed, entertained and inspired every day.

Location: CT/JHB Our client, a well-known South African media and technology company, is looking for a Senior Cloud Data Engineer to join their team. This organisation is behind some of the country's most recognisable digital news and information brands, and its in-house team of engineers, data scientists, product managers and UX/UI designers builds the digital products that keep millions of South Africans informed, entertained and inspired every day.

Why join this team?

You’ll be joining a people-focused, innovation-driven engineering culture that uses a sophisticated, modern tech stack to deliver world-class digital solutions. This is a business with a strong societal mission, and the data engineering team plays a central role in turning raw data into the stories and insights that help decision-makers steer the business forward.

What will you do?

You’ll work primarily within a Google Cloud environment, using tools across the Google stack, from BigQuery and Dataproc to Kubernetes and AI Hub. You should be comfortable thinking in Python and speaking fluent SQL, and you shouldn't be afraid to dive into messy, unstructured data and help the wider team make sense of it. Ultimately, you'll be helping transform data into the stories and visuals that drive real business decisions.

What You'll Need

• A relevant software engineering degree, at least at Honours level (a Masters would be advantageous)
• 5+ years of development experience working with Python
• Strong data skills, including both traditional SQL and NoSQL
• Experience with large-scale ETL processes
• Experience building high-scale RESTful services
• Cloud experience, ideally with Google Cloud Platform
• Experience using source control (Git)

Beneficial skills

You’ll be exposed to the following in this environment, so prior experience is a bonus but not essential:

• Scheduling and orchestration (Airflow/Composer)
• Containerisation (Kubernetes, Docker)
• BigQuery
• Elasticsearch
• Data warehousing concepts
• Data governance concepts
• Apache Beam (Cloud Dataflow)
• Apache Spark (Dataproc)

What's in it for you?

• AI-forward culture: this organisation actively looks for ways to leverage AI to unlock new opportunities, and encourages its teams to explore and experiment with cutting-edge tools to boost productivity and results.
• Continuous learning and growth: benefit from a wealth of learning opportunities, including free access to platforms like Udemy, the chance to pursue nanodegrees, complimentary Microsoft certification training, and bursary opportunities, all backed by a major listed parent group.
• Stay ahead: attend leading tech events and expos to keep up with industry trends and innovation.
• Personalised benefits: choose from optional medical aid and customisable retirement funding options to suit your needs.
• Give back: take up to 3 days of paid volunteering leave each year to support causes you care about.

In line with our client's employment equity policy, preference will be given to suitable candidates from designated groups.