Senior Data Engineer

Clouddevs; Gauteng; Remote; ZAR 200 000 - 300 000; Full time

Job summary

A leading cloud solutions provider in South Africa, Gauteng is seeking a Senior Data Engineer to design and maintain cutting-edge data solutions. You'll work with various database systems and lead technical teams to develop data pipelines. This role offers competitive compensation, flexible working hours, and significant learning opportunities in a supportive environment.

Benefits

Competitive industry benchmark compensation

Flexible working hours

Company-sponsored learning and certifications

Work-life balance

No working on your birthday

Qualifications

• 5+ years of progressive experience in data engineering, cloud computing, and technology implementation.
• Proven experience leading technical teams and mentoring team members.
• Experience managing multi-shore projects and working within cloud ecosystems.

Responsibilities

• Building and maintaining efficient ETL / ELT pipelines.
• Developing robust database schemas and dimensional models.
• Contributing to the development of data warehouses and data lakes.

Skills

Python

SQL

Apache Airflow

PySpark

Databricks

Cloud platforms

APIs

Education

Bachelor's degree in Computer Science, Data Science or related fields

Tools

Azure SQL

PostgreSQL

Google BigQuery

MongoDB

Google Firestore

Job description

Are you a highly skilled Senior Data Engineer ready to lead and innovate in a dynamic, cloud-driven environment?

We're looking for a pivotal team member to design, develop, and maintain cutting-edge data solutions, ensuring scalability, reliability, and top-tier performance.

If you have a strong background in data engineering, a proven track record in leading technical teams, and thrive in an agile setting, we want to hear from you.

What You'll Be Doing

• Building and maintaining efficient ETL / ELT pipelines using tools like Apache Airflow and PySpark.
• Developing robust database schemas, dimensional models (Kimball / Inmon), and supporting data normalisation for both relational and NoSQL databases.
• Contributing to the development and maintenance of our data warehouses, data lakes, and data lakehouses.
• Working with diverse database systems, including Azure SQL, PostgreSQL, Google BigQuery, MongoDB, and Google Firestore.
• Handling structured, semi-structured, and big data file formats such as Avro, CSV, Parquet, ORC, and Delta.
• Developing and maintaining APIs for seamless data integration and workflows, with a solid understanding of REST and microservices architectures.
• Overseeing codebase maintenance and optimisation, leveraging Git for version control.
• Implementing thorough integration testing and ensuring high-quality deliverables for all new data processing scenarios.
• Providing technical design and coding assistance to team members, ensuring successful project milestones.
• Assessing and integrating new data sources to meet evolving business needs.

What We're Looking For

• Strong proficiency in Python and SQL (PostgreSQL or SQL Server preferred).
• Hands‑on experience with Apache Airflow and PySpark.
• Familiarity with Databricks is essential.
• Working knowledge of cloud platforms such as Azure, GCP, or AWS.
• Experience with data warehousing concepts, dimensional modelling, and database normalisation.
• Understanding of big data file formats like Avro, Parquet, ORC, and Delta.
• Proficiency in working with APIs, REST, and microservices architectures.

Education & Experience

• A Bachelor's degree in Computer Science, Data Science, or related fields.
• 5+ years of progressive experience in data engineering, cloud computing, and technology implementation.
• Experience managing multi‑shore projects and working within cloud ecosystems (SaaS / PaaS).
• Proven experience leading technical teams and mentoring team members.

What You Will Get Out

• You'll get to develop your skill set.
• A competitive, industry benchmark compensation.
• Flexible working hours and a remote office setting.

You’ll be part of a rapidly growing business.

Work with the absolute masters in the industry and catch some of their energy, vibe, and passion for what we do.

Great coffee every day, and samoosa Fridays (in‑office of course).

Plenty of company‑sponsored learning; certifications and incentives.

Work Hard.

Play Hard.

Work‑Life Balance.

No working on your birthday (free day off).