Data Platform Engineer New Cape Town

Impact; Cape Town; Hybrid; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Flexible Working

Mental health & wellness support

RSUs

Coursera subscription

Parental leave

Tech stipend

Job summary

impact.com in Cape Town, South Africa, is seeking a Data Platform Engineer to own production TB-scale pipelines and platform components. You will design scalable batch and streaming data workflows, ensure reliability, and contribute to governance, security, and cost management.

You’ll work with a Data Analytics Group and partner with Analytics Engineers, Data Analysts, and Data Scientists, reporting to the Team Lead, Data Platform Engineering, in a hybrid setup with two in-office days weekly.

Qualifications

• 3-5 years of experience in data platform, data engineering, or backend/distributed systems engineering, including ownership of production systems at TB-scale or SLA-driven environments.
• Strong Python, plus production experience in a JVM language; Scala preferred for pipelines; able to write production-grade code with proper error handling, logging, and testing.
• Hands-on depth in distributed batch processing (Spark) or streaming (Kafka/ Pub/Sub) with familiarity of the other.

Responsibilities

• Own end-to-end pipeline design, implementation, reliability, performance, and cost.
• Configure and maintain core platform infra as code (Dataproc, Kafka, Airflow, BigQuery, Cloud Storage).
• Tune query performance, partitioning, and streaming configurations for throughput and reliability.
• Implement security and governance by design (access control, secrets, encryption, audit logging).
• Write clean, tested code with CI/CD and maintain runbooks/docs; mentor junior engineers.

Skills

Python

Scala

Spark

Kafka

BigQuery

Dataproc

Airflow

SQL

GCP

CI/CD

Security

Mentoring

Communication

Education

Bachelor's degree in CS/Engineering

Tools

Airflow

Dataproc

Kafka

BigQuery

Pub/Sub

Cloud Storage

Git

Job description

impact.com is the world’s leading commerce partnership marketing platform, transforming the way businesses grow by enabling them to discover, manage, and scale partnerships across the entire customer journey. From affiliates and influencers to content publishers, brand ambassadors, and customer advocates, impact.com empowers brands to drive trusted, performance-based growth through authentic relationships. Its award-winning products—Performance (affiliate), Creator (influencer), and Advocate (customer referral)—unify every type of partner into one integrated platform. As consumers increasingly rely on recommendations from people and communities they trust, impact.com helps brands show up where it matters most. Today, over 5,000 global brands, including Walmart, Uber, Shopify, Lenovo, L’Oréal, and Fanatics, rely on impact.com to power more than 225,000 partnerships that deliver measurable business results.

Your Role at Impact:

Impact's Data Platform Engineering team is looking for a Data Platform Engineer ready to independently own production pipelines and platform components at TB-scale, delivering data reliably, securely, and cost-effectively as the business grows.

You’ll design and build scalable batch and streaming pipelines, own the reliability, performance, and SLOs of your domain, and participate fully in on-call as a Tier 2 responder. You’ll work within the Data Analytics Group (DAG), partnering closely with Analytics Engineers, Data Analysts, Data Scientists, and Data Product Managers, though you won’t own dbt models, metric definitions, or reporting. We operate with a platform-as-a-product mindset: the platform is an internal product with clear interfaces, paved roads, and strong developer experience, and success is measured by the productivity of the teams who depend on it. Our ideal candidate combines solid distributed systems engineering with operational maturity, clear communication, and a habit of mentoring those earlier in their careers.The role reports to the Team Lead, Data Platform Engineering, and is based in Cape Town, hybrid, with two days per week in office.

The platform:

The platform has strong foundations: Scala and Spark pipelines processing TB-scale data, dozens of managed data connectors, Airflow on Astronomer for orchestration, a mature dbt transformation layer, and BigQuery as the core analytical warehouse. You’ll also have room to shape the platform’s next chapter: modernising parts of the compute stack, and building out governance frameworks, data contracts, SLOs, observability, cost management, and data quality monitoring within your domain.

What You’ll Do:

• End-to-end domain ownership: Own platform components and a pipeline domain end-to-end, including design, implementation, reliability, performance, and cost. Design and build scalable ETL/ELT and streaming pipelines using Spark/Dataproc, Kafka, and Pub/Sub. Integrate diverse sources into BigQuery and other stores. Build modular, fault-tolerant components with graceful schema evolution.
• Infrastructure & performance tuning: Configure and maintain core platform infrastructure as code, including Dataproc, Kafka, Airflow/Astronomer, BigQuery, and Cloud Storage. Tune performance and cost through query optimisation, partitioning, and resource configuration. Tune streaming configurations for throughput and reliability.
• Reliability & incident response: Own and track SLOs for freshness, success, and latency. Implement monitoring, alerting, and data quality checks. Participate in on-call as a Tier 2 responder, troubleshooting and resolving incidents independently.
• Security, governance & self-service: Implement security and governance by design, including access control, secrets, encryption, audit logging, lineage, and retention. Build self-service capabilities and paved roads for analytics engineers, analysts, and data scientists.
• Engineering craft & documentation: Write clean, well-tested code with CI/CD and current runbooks and architecture docs. Use AI coding assistants while holding the same quality and review standards.
• Mentorship & communication: Mentor Associate Data Platform Engineers through pairing and code review. Communicate platform trade-offs clearly and contribute to platform standards and data contracts.

What You Have:

Preferred Requirements:

• 3 to 5 years of experience in data platform, data engineering, or backend/distributed systems engineering, including ownership of production systems at TB-scale, or systems carrying stringent SLAs, multiple downstream consumers, or compliance requirements
• Strong Python, plus production experience in a JVM language, with the ability to write production-quality code with proper error handling, logging, and testing. Scala is our primary pipeline language: if you don't have it yet, you'll need a real appetite to become strong in it
• Hands‑on depth in either distributed batch processing (Spark: DataFrames, Spark SQL, partitioning, shuffles, fault tolerance) or streaming (Kafka or Pub/Sub: producers, consumers, topics, partitions, stream processing patterns), with working familiarity of the other
• Advanced SQL, including complex queries, window functions, CTEs, and query optimisation
• Experience with workflow orchestration such as Airflow: scheduling, dependencies, retry logic, and workflow coordination
• Working fluency with a major cloud platform, ideally GCP (BigQuery, Dataproc, Cloud Storage, Pub/Sub)
• Solid engineering and operational practice: Git, CI/CD, automated testing, code review, monitoring, alerting, and incident response including on-call
• Security and governance practice in data systems: access control, secrets management, encryption, and least-privilege design
• Clear written and verbal communication for a distributed team, plus some experience or aptitude for mentoring less experienced engineers

Nice to Have (Advantageous) Requirements:

• Infrastructure as code (Terraform or equivalent) and automated deployment
• Experience migrating legacy big-data platforms onto cloud-native alternatives
• Familiarity with dbt, Looker, or semantic layer concepts, and with dbt orchestration through Astronomer Cosmos
• Functional Scala patterns (cats-effect and the Typelevel ecosystem), or JVM tuning exposure such as garbage collection, memory management, and thread pools
• Observability tooling such as Grafana, Datadog, or Cloud Monitoring
• Experience with Dataflow (Apache Beam), SingleStore, or BigTable
• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field is a plus
• Experience in the digital marketing technology industry is a plus

Benefits and Perks:

At impact.com, we believe that when you’re happy and fulfilled, you do your best work. That’s why we’ve built a benefits package that supports your well-being, growth, and work-life balance.

• Flexible Working: Our Responsible PTO policy means you can take the time off you need to rest and recharge. We're committed to a positive work-life balance and provide a flexible environment that allows you to be happy and fulfilled in both your career and your personal life.
• Health and Wellness: Your well-being is a priority. Our mental health and wellness benefit includes up to 12 fully covered therapy/coaching sessions per year, with additional dependent coverage. We also offer a monthly gym reimbursement policy to support your physical health.
• A Stake in Our Growth: We offer Restricted Stock Units (RSUs) as part of our total compensation, giving you a stake in the company's growth with a 3‑year vesting schedule, pending Board approval.
• Investing in Your Growth: We’re committed to your continuous learning. Take advantage of our free Coursera subscription and our PXA courses.
• Parental Support: We offer a generous parental leave policy, 26 weeks of fully paid leave for the primary caregiver and 13 weeks fully paid leave for the secondary caregiver.
• Technology Financial Support: We provide a technology stipend to help you set up your home office and a monthly allowance to cover your internet expenses

impact.com is proud to be an equal opportunity workplace. All employees and applicants for employment shall be given fair treatment and equal employment opportunity regardless of their race, ethnicity or ancestry, color or caste, religion or belief, age, sex (including gender identity, gender reassignment, sexual orientation, pregnancy/maternity), national origin, weight, neurodivergence, disability, marital and civil partnership status, caregiving status, veteran status, genetic information, political affiliation, or other prohibited non-merit factors.

#LI-CT1

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in impact.com’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.