Senior Data Engineer, Big Data Pipelines (Onsite Upington)

Placements24

Upington

On-site

ZAR 900,000 - 1,200,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
In-office Upington location
Professional development
Access to modern data tech
Generous leave

Job summary

Placements24 is seeking a Senior Data Engineer to join the team in Upington, Northern Cape, in-office. The role focuses on building scalable data pipelines, managing data warehouses and data lakes, and ensuring data quality for BI initiatives.

You will work with data scientists, analysts, and stakeholders to translate data needs into robust solutions, leveraging Spark, Hadoop, and cloud platforms. A strong programming background and experience with large datasets are essential for success.

Qualifications

  • Bachelor's or higher in CS/Engineering; Master's preferred.
  • 5+ years in data engineering or similar role.
  • Proficient in Python, Scala or Java and big data tech.

Responsibilities

  • Design, build, test, and maintain scalable data pipelines and ETL/ELT processes.
  • Develop data warehousing solutions and data lakes.
  • Optimize data retrieval for performance and cost.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
  • Ensure data quality, integrity, and security across data systems.

Skills

Python/Scala/Java
Big data technologies
SQL proficiency
Data warehousing concepts
Communication skills
Independent/team collaboration

Education

Bachelor's degree in CS/Engineering
Master's degree preferred

Tools

Apache Spark
Hadoop ecosystem
Hive
Kafka
PostgreSQL/MySQL
AWS Redshift/S3
Azure Data Lake/Google BigQuery
Docker

Job description

Placements24 is seeking a Senior Data Engineer to join the team in Upington, Northern Cape, in-office. The role focuses on building scalable data pipelines, managing data warehouses and data lakes, and ensuring data quality for BI initiatives.

You will work with data scientists, analysts, and stakeholders to translate data needs into robust solutions, leveraging Spark, Hadoop, and cloud platforms. A strong programming background and experience with large datasets are essential for success.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, Data Engineering (Hybrid—Upington)
Senior Software Engineer, Data Engineering (Hybrid—Upington)

Placements24 • Upington

Hybrid
ZAR 900,000 - 1,200,000
Performance bonuses
Medical aid and retirement benefits
Professional development opportunities
Lead Big Data Engineer - Hybrid, Data Lakes & Pipelines
Lead Big Data Engineer - Hybrid, Data Lakes & Pipelines

Placements24 • Upington

Hybrid
ZAR 1,200,000 - 1,800,000
Health benefits
Hybrid work model
Performance bonuses
+1
Data Engineer: AI Platforms & Scalable Pipelines
Data Engineer: AI Platforms & Scalable Pipelines

Placements24 • Upington

On-site
ZAR 600,000 - 900,000
Competitive salary
Medical aid
Retirement plan
+2
Senior Data Engineer: Scalable Pipelines & Data Platform
Senior Data Engineer: Scalable Pipelines & Data Platform

Placements24 • Vereeniging

On-site
ZAR 700,000 - 1,100,000
Competitive salary package and bonus
Comprehensive health, dental, and退休/RE
Opportunities for professional develop
Hybrid Data Engineer: Build Scalable Pipelines & Lakes
Hybrid Data Engineer: Build Scalable Pipelines & Lakes

Placements24 • Upington

Hybrid
ZAR 600,000 - 900,000
Competitive bonus
Medical aid
Hybrid work
+1
Senior Data Engineer (Big Data Technologies)
Senior Data Engineer (Big Data Technologies)

Placements24 • Upington

On-site
ZAR 900,000 - 1,200,000
Competitive salary
In-office Upington location
Professional development
+2
Senior Data Engineer: Scalable Pipelines & Flexible Hours
Senior Data Engineer: Scalable Pipelines & Flexible Hours

Placements24 • Paarl

Hybrid
ZAR 900,000 - 1,200,000
Competitive salary and benefits
Health and wellness benefits
Retirement savings plan
+4
Data Engineer
Data Engineer

Placements24 • Upington

Hybrid
ZAR 600,000 - 900,000
Competitive bonus
Medical aid
Hybrid work
+1
Hybrid Senior Data Engineer - Big Data & ETL Pipelines
Hybrid Senior Data Engineer - Big Data & ETL Pipelines

Placements24 • Sandton

Hybrid
ZAR 900,000 - 1,600,000
Competitive salary
Hybrid work arrangement
Professional development opportunities
+2
Senior Data Engineer - Remote | Big Data & Cloud
Senior Data Engineer - Remote | Big Data & Cloud

Placements24 • Upington

Hybrid
ZAR 1,000,000 - 1,300,000
Competitive salary
Performance bonuses
Health & wellness benefits
+2