Senior Cloud Data Engineer

Liquid Thought; Cape Town; On-site; ZAR 800,000 - 1,100,000; Full time

Job summary

A top-tier South African company is seeking a skilled Senior Cloud Data Engineer to join their Cape Town team in-office. The successful candidate will work extensively within the Google Cloud environment, utilizing tools like BigQuery, Dataproc, and Kubernetes. Ideal applicants will possess a Master's degree, along with over 5 years of development experience in Python and solid SQL skills. This role focuses on complex datasets, contributing to impactful digital products that resonate with millions daily.

Qualifications

• 5+ years development experience working with Python.
• Experience with traditional SQL and No-SQL databases.
• Knowledge of high-scale Restful services.

Responsibilities

• Work within the Google Cloud Environment using various tools.
• Wrangle complex datasets and contribute to impactful products.
• Help the team make sense of dirty data.

Skills

Python

SQL

Data analysis

Cloud computing

Git

Education

Honours/Master's degree in Computer Science or Software Engineering

Tools

Google Cloud Platform

BigQuery

Dataproc

Kubernetes

Airflow/Composer

Job description

About the job Senior Cloud Data Engineer

Location: Cape Town (In-Office)

Are you passionate about building impactful digital products that reach millions daily? Our client, atop-tier South African company is looking for a talented and experienced Senior Cloud Data Engineer to join their innovative, cross-functional team. You'll work on high-scale systems in the cloud, wrangle complex datasets, and contribute to products that inform, entertain, and inspire.

Key Responsibilities:

You will be working primarily within the Google Cloud Environment using a variety of the tools that Google offers from Biquery and Dataproc to Kubernettes and AI Hub. You should ideally dream in Python and speak SQL. You should not be afraid to dive into dirty data and help the team make sense of it.

Required Qualifications & Experience:

• Honours/Master's degree in Computer Science or Software Engineering
• 5+ years development experience working with Python
• Data skills (Traditional SQL and No-SQL)
• High scale Restful Services
• Cloud experience (Google cloud platform preferred)
• Experience with source control (Git)

Beneficial Skills:

You will be exposed to these in their environment, great if you have it but not a problem if you don't.

• Scheduling and Orchestration (Airflow/Composer)