Senior Data Engineer: Lead ETL, Data Warehousing & Cloud

CloudDevs; South Africa; Remote; ZAR 600,000 - 800,000; Full time

Benefits offered by this job

Flexible working hours

Competitive compensation

Company-sponsored learning and certifications

Work-Life Balance

Free day off on your birthday

Great coffee every day

Job summary

A technology solutions company is seeking a Senior Data Engineer to lead and innovate in a cloud-driven environment. This role involves designing and maintaining data solutions, building ETL/ELT pipelines, and managing diverse database systems. Candidates should have a Bachelor's degree and over 5 years of progressive experience in data engineering and cloud computing, as well as strong proficiency in Python and SQL.

Qualifications

• 5+ years of progressive experience in data engineering, cloud computing, and technology implementation.
• Experience managing multi-shore projects and working within cloud ecosystems (SaaS/PaaS).
• Proven experience leading technical teams and mentoring team members.

Responsibilities

• Building and maintaining efficient ETL/ELT pipelines using tools like Apache Airflow and PySpark.
• Developing robust database schemas and supporting data normalization for both relational and NoSQL databases.
• Contributing to the development and maintenance of data warehouses, data lakes, and data lakehouses.
• Developing and maintaining APIs for seamless data integration and workflows.
• Implementing thorough integration testing and ensuring high-quality deliverables.

Skills

Python

SQL (PostgreSQL or SQL Server)

Apache Airflow

PySpark

Databricks

Cloud platforms (Azure, GCP, AWS)

APIs

REST

Microservices

Education

Bachelor’s degree in Computer Science, Data Science, or related fields

Job description

A technology solutions company is seeking a Senior Data Engineer to lead and innovate in a cloud-driven environment. This role involves designing and maintaining data solutions, building ETL/ELT pipelines, and managing diverse database systems. Candidates should have a Bachelor's degree and over 5 years of progressive experience in data engineering and cloud computing, as well as strong proficiency in Python and SQL.