Senior Data Engineer - Remote, End-to-End Pipelines

HR Talent Partner SA; United States; Remote; USD 54,000 - 90,000; Full time

Benefits offered by this job

Remote work

Option for weekly office

Job summary

HR Talent Partner SA is recruiting a Senior Data Engineer for a fully remote role in South Africa with the option to work from the office once a week. You will join a growing data platform team and align marketing, payments and product data with business goals.

You will build and operate pipelines feeding daily reporting, attribution and LTV, collaborating with Analytics, Marketing and Data Science. Strong Python/SQL/Spark skills and experience with Databricks and Airflow are essential.

Qualifications

• Experience with Python, SQL, Spark, Databricks (Unity Catalog and Delta), Airflow and GCP.
• Own production data pipelines end-to-end.
• Curiosity about marketing spend, subscriptions and attribution, not only pipelines.
• Excellent analytical and problem-solving abilities with a strategic approach.
• Strong collaboration and communication across all levels.
• Solid understanding of agile methodologies.
• Advanced spoken and written English.
• Nice-to-have: dbt; Ads and payments APIs such as Google Ads, Stripe or RevenueCat.

Responsibilities

• Ingest data from ad platforms, payment systems and product backends into Databricks.
• Orchestrate jobs in Airflow and keep silver and gold tables accurate and on time.
• Own production: scheduled jobs, data quality checks, alerting and getting a failed daily run back on track.
• Proactively identify, troubleshoot and resolve issues to improve internal and external processes.
• Balance multiple projects without sacrificing quality, in line with brand standards and regulatory requirements.
• Work with product, engineering and marketing stakeholders to gather requirements, evaluate optionsand build tools and processes.

Skills

Python

SQL

Spark

Databricks

Airflow

GCP

English

Agile

Tools

Databricks

Airflow

BigQuery

GCS

Job description

HR Talent Partner SA is recruiting a Senior Data Engineer for a fully remote role in South Africa with the option to work from the office once a week. You will join a growing data platform team and align marketing, payments and product data with business goals.

You will build and operate pipelines feeding daily reporting, attribution and LTV, collaborating with Analytics, Marketing and Data Science. Strong Python/SQL/Spark skills and experience with Databricks and Airflow are essential.