Senior Cloud Data Engineer

Liquid Thought; Cape Town; On-site; ZAR 900,000 - 1,500,000; Full time

Job summary

Liquid Thought in Cape Town is seeking a Senior Cloud Data Engineer to join their in-office team. You will work on high-scale data systems, wrangling complex datasets and building digital products that reach millions daily.

You will primarily operate in the Google Cloud environment with BigQuery, Dataproc, Kubernetes, and AI Hub, writing Python and SQL to tame dirty data and deliver reliable data services. Experience with Git is advantageous.

Qualifications

• Honours or Master's degree in Computer Science or Software Engineering.
• 5+ years development experience using Python.
• Experience with traditional SQL and NoSQL databases.
• Experience with high-scale RESTful services.
• Cloud experience, Google Cloud Platform preferred.
• Experience with source control (Git).

Responsibilities

• You will be working primarily within the Google Cloud Environment using a variety of the tools that Google offers from BigQuery and Dataproc to Kubernetes and AI Hub.
• You should ideally dream in Python and speak SQL.
• You should not be afraid to dive into dirty data and help the team make sense of it.

Skills

Python

SQL

NoSQL

RESTful services

Google Cloud Platform

Education

Honours/Master's degree in Computer Science or Software Engineering

Tools

BigQuery

Dataproc

Kubernetes

AI Hub

Git

Job description

About the job Senior Cloud Data Engineer

Location: Cape Town (In-Office)

Are you passionate about building impactful digital products that reach millions daily? Our client, atop-tier South African company is looking for a talented and experienced Senior Cloud Data Engineer to join their innovative, cross-functional team. You'll work on high-scale systems in the cloud, wrangle complex datasets, and contribute to products that inform, entertain, and inspire.

Key Responsibilities:

You will be working primarily within the Google Cloud Environment using a variety of the tools that Google offers from Biquery and Dataproc to Kubernettes and AI Hub. You should ideally dream in Python and speak SQL. You should not be afraid to dive into dirty data and help the team make sense of it.

Required Qualifications & Experience:

• Honours/Master's degree in Computer Science or Software Engineering
• 5+ years development experience working with Python
• Data skills (Traditional SQL and No-SQL)
• High scale Restful Services
• Cloud experience (Google cloud platform preferred)
• Experience with source control (Git)

Beneficial Skills:

You will be exposed to these in their environment, great if you have it but not a problem if you don't.

• Scheduling and Orchestration (Airflow/Composer)