Senior Cloud Data Engineer - Melrose Arch (Hybrid) - R1.08m PA

E-Merge; South Africa; Sur place; ZAR 972 000 - 1 188 000; Plein temps

Résumé du poste

E-Merge in Melrose Arch, Johannesburg, South Africa, is looking for a seasoned Data Engineer to design and optimize scalable data pipelines, enable advanced analytics, and drive data engineering excellence in a cloud-first environment.

You will partner with data scientists and engineers to build API‑based ingestion, implement CI/CD for data workflows, and mentor juniors while delivering robust, maintainable code that supports business decisions across the organization.

Qualifications

• 7+ years of professional experience as a Data Engineer or in a similar role developing data ETL pipelines.
• Advanced proficiency in Python for backend development and scripting
• Strong SQL skills with hands-on experience in querying and modeling relational databases
• Experience with cloud platforms such as AWS, GCP, or Azure
• Hands-on with containerization technologies like Docker or Kubernetes
• Solid understanding of RESTful APIs
• Experience with version control systems (GitHub, GitLab, Bitbucket) and CI/CD workflows
• Strong grasp of software development lifecycle (SDLC) and principles of clean, maintainable code
• Demonstrated ability to work independently, own projects end-to-end, and mentor junior engineers
• Familiarity with AI concepts and prompt engineering is a plus

Responsabilités

• Design, develop, test, and maintain reliable data pipelines and ETL processes using Python and SQL
• Build and manage API-based data ingestion workflows and real-time data integrations
• Apply software engineering best practices: modular design, testing, version control, and documentation
• Own and optimize data workflows and automation, ensuring efficiency and scalability
• Collaborate closely with senior engineers, data scientists, and stakeholders to translate business needs into technical solutions
• Work with data-devops principles: CI/CD for data workflows, infrastructure-as-code, and containerized ETL deployments

Connaissances

Python

SQL

Cloud platforms

Docker

Kubernetes

REST APIs

Git & CI/CD

SDLC

Mentoring

AI concepts

Outils

Terraform

Helm

Description du poste

Are you passionate about building scalable data platforms that power intelligent decision-making? Join an innovative, fast-growing technology team where you'll design and optimize modern data pipelines, enable advanced analytics, and drive data engineering excellence. If you thrive in a collaborative, cloud-first environment and enjoy solving complex data challenges with cutting-edge technologies, this is an opportunity to make a meaningful impact while advancing your career.

What You Bring

• 7+ years of professional experience as a Data Engineer or in a similar role developing data ETL pipelines.
• Advanced proficiency in Python for backend development and scripting
• Strong SQL skills with hands-on experience in querying and modeling relational databases
• Experience with cloud platforms such as AWS, GCP, or Azure
• Hands-on with containerization technologies like Docker or Kubernetes
• Solid understanding of RESTful APIs
• Experience with version control systems (GitHub, GitLab, Bitbucket) and CI/CD workflows
• Strong grasp of software development lifecycle (SDLC) and principles of clean, maintainable code
• Demonstrated ability to work independently, own projects end-to-end, and mentor junior engineers
• Familiarity with AI concepts and prompt engineering is a plus

Nice to Have

• Experience with data security, privacy compliance, and access controls
• Knowledge of infrastructure-as-code tools (e.g., Terraform, Helm)
• Background in event-driven architecture or stream processing

What You'll Do

• Design, develop, test, and maintain reliable data pipelines and ETL processes using Python and SQL
• Build and manage API-based data ingestion workflows and real-time data integrations
• Apply software engineering best practices: modular design, testing, version control, and documentation
• Own and optimize data workflows and automation, ensuring efficiency and scalability
• Collaborate closely with senior engineers, data scientists, and stakeholders to translate business needs into technical solutions
• Work with data-devops principles: CI/CD for data workflows, infrastructure-as-code, and containerized ETL deployments

Reference Number for this position is GZ60844 which is a permanent Hybrid position based in Melrose Arch offering a salary of R1.08m per annum, negotiable based on experience and ability.