Senior Data Engineer

E-Merge IT Recruitment; Johannesburg; Hybrid; ZAR 800 000 - 1 000 000; Full time

Job summary

A dynamic tech recruitment agency is seeking a Senior Data Engineer in Johannesburg. This role involves designing scalable data infrastructure and building tools for data-driven decisions. Candidates should have 7+ years of experience, strong Python and SQL skills, and proven expertise with cloud platforms. The position offers a negotiable salary of R800k to R1mil CTC.

Qualifications

• 7+ years of professional experience in data engineering or related roles.
• Proven experience with cloud platforms (AWS, GCP, Azure).
• Strong understanding of RESTful APIs and data integration.

Responsibilities

• Design, develop, and maintain reliable data pipelines and ETL processes using Python and SQL.
• Build and manage API-based ingestion and real-time data integration workflows.
• Implement observability, monitoring, and alerting for data pipeline health.

Skills

Python development

SQL expertise

Cloud platforms (AWS, GCP, Azure)

Docker

Kubernetes

RESTful APIs

Version control (GitHub/GitLab/Bitbucket)

CI/CD workflows

SDLC principles

Job description

Join is a fast-growing B2B SaaS startup revolutionizing cybersecurity compliance for businesses worldwide. Our Compliance-as-a-Service platform simplifies leading frameworks like SOC 2, ISO 27001, HIPAA, GDPR, and PCI DSS, empowering startups, scale-ups, and enterprises to achieve and maintain compliance effortlessly. As a Senior Data Engineer you will design scalable data infrastructure, implement robust integrations, and build tools that enable smarter, data-driven decisions across the organization.

Responsibilities

• Design, develop, and maintain reliable data pipelines and ETL processes using Python and SQL.
• Build and manage API-based ingestion and real-time data integration workflows.
• Apply software engineering best practices — modular design, testing, version control, and documentation.
• Optimize and automate data workflows for efficiency, scalability, and reliability.
• Partner with data scientists, engineers, and business stakeholders to translate requirements into technical solutions.
• Implement observability, monitoring, and alerting for data pipeline health.
• Support internal data tools that empower analytics and product decisions.
• Apply data-devops principles — CI / CD for data workflows, infrastructure-as-code, and containerized ETL deployments.

Qualifications and experience

• 7+ years of professional experience in data engineering or related roles.
• Advanced Python development skills and solid SQL expertise.
• Proven experience with cloud platforms (AWS, GCP, or Azure).
• Hands‑on with Docker and / or Kubernetes for containerized deployments.
• Strong understanding of RESTful APIs and data integration design.
• Experience with version control (GitHub / GitLab / Bitbucket) and CI / CD workflows.
• Deep grasp of SDLC principles and clean, maintainable coding practices.
• Track record of owning projects end‑to‑end and mentoring junior engineers.
• Familiarity with AI concepts or prompt engineering is a plus.

The reference number for this position is NG60855 which is a permanent, hybrid position in Johannesburg offering a salary of R800k up to R1mil CTC salary negotiable based on experience.