TB-Scale Data Platform Engineer — Hybrid Cape Town

Impact; Cape Town; Híbrido; ZAR 900 000 - 1 300 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Flexible Working

Mental health & wellness support

RSUs

Coursera subscription

Parental leave

Tech stipend

Resumo da oferta

impact.com in Cape Town, South Africa, is seeking a Data Platform Engineer to own production TB-scale pipelines and platform components. You will design scalable batch and streaming data workflows, ensure reliability, and contribute to governance, security, and cost management.

You’ll work with a Data Analytics Group and partner with Analytics Engineers, Data Analysts, and Data Scientists, reporting to the Team Lead, Data Platform Engineering, in a hybrid setup with two in-office days weekly.

Qualificações

• 3-5 years of experience in data platform, data engineering, or backend/distributed systems engineering, including ownership of production systems at TB-scale or SLA-driven environments.
• Strong Python, plus production experience in a JVM language; Scala preferred for pipelines; able to write production-grade code with proper error handling, logging, and testing.
• Hands-on depth in distributed batch processing (Spark) or streaming (Kafka/ Pub/Sub) with familiarity of the other.

Responsabilidades

• Own end-to-end pipeline design, implementation, reliability, performance, and cost.
• Configure and maintain core platform infra as code (Dataproc, Kafka, Airflow, BigQuery, Cloud Storage).
• Tune query performance, partitioning, and streaming configurations for throughput and reliability.
• Implement security and governance by design (access control, secrets, encryption, audit logging).
• Write clean, tested code with CI/CD and maintain runbooks/docs; mentor junior engineers.

Conhecimentos

Python

Scala

Spark

Kafka

BigQuery

Dataproc

Airflow

SQL

GCP

CI/CD

Security

Mentoring

Communication

Formação académica

Bachelor's degree in CS/Engineering

Ferramentas

Airflow

Dataproc

Kafka

BigQuery

Pub/Sub

Cloud Storage

Git

Descrição da oferta de emprego

impact.com in Cape Town, South Africa, is seeking a Data Platform Engineer to own production TB-scale pipelines and platform components. You will design scalable batch and streaming data workflows, ensure reliability, and contribute to governance, security, and cost management.

You’ll work with a Data Analytics Group and partner with Analytics Engineers, Data Analysts, and Data Scientists, reporting to the Team Lead, Data Platform Engineering, in a hybrid setup with two in-office days weekly.