Senior Data Engineer, AI Pipelines – Remote (SA)

HR Talent Partner SA; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

HR Talent Partner SA is seeking a Senior Data Engineer (AI Engineering) for a fully remote role with optional hybrid office time in South Africa. The role focuses on building and operating pipelines feeding daily reporting, attribution and LTV, collaborating with Analytics, Marketing and Data Science.

Requirements include experience with Python, SQL, Spark, Databricks, Airflow, and GCP, plus strong English communication and agile methods. Nice-to-have: dbt and ads/payments APIs.

Qualifications

• Experience with Python, SQL, Spark, Databricks (Unity Catalog and Delta), Apache Airflow and GCP (GCS and BigQuery).
• Comfort owning production data pipelines end-to-end.
• Curiosity about marketing spend, subscriptions and attribution, not only the pipelines.

Responsibilities

• Ingest data from ad platforms, payment systems and product backends into Databricks.
• Orchestrate jobs in Airflow and keep silver and gold tables accurate and on time.
• Own production: scheduled jobs, data quality checks, alerting and getting a failed daily run back on track.

Skills

Python

SQL

Spark

Databricks

Airflow

GCP

BigQuery

Unity Catalog

Delta

English (Advanced)

Tools

Databricks

Airflow

GCP

BigQuery

Job description

HR Talent Partner SA is seeking a Senior Data Engineer (AI Engineering) for a fully remote role with optional hybrid office time in South Africa. The role focuses on building and operating pipelines feeding daily reporting, attribution and LTV, collaborating with Analytics, Marketing and Data Science.

Requirements include experience with Python, SQL, Spark, Databricks, Airflow, and GCP, plus strong English communication and agile methods. Nice-to-have: dbt and ads/payments APIs.