Hybrid Data Engineer: Build Scalable Pipelines & Lakes

Placements24

Upington

On-site

ZAR 480,000 - 900,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary & bonus
Medical aid & retirement plan
Learning & growth opportunities
Team-oriented environment
Generous leave

Job summary

Placements24 in Upington seeks a skilled Data Engineer to design, build and maintain robust data platforms powering AI initiatives.

You will create scalable data pipelines, ensure data quality and security, and collaborate with data scientists to meet analytical needs. The role offers opportunities to work with Spark, cloud services and modern data warehousing.

Qualifications

  • Bachelor's degree in Computer Science, Engineering or related field.
  • 3–5 years of data engineering experience.
  • Proficient in SQL with relational and NoSQL databases.
  • Strong Python or Scala programming skills.
  • Experience with big data tech such as Spark or Hadoop.
  • Familiar with cloud data services (Redshift, S3, Data Lake, BigQuery).

Responsibilities

  • Design, construct, install, test, and maintain scalable data management systems.
  • Develop and optimize ETL pipelines for data extraction, transformation, and loading.
  • Collaborate with data scientists and AI engineers to meet data needs.
  • Ensure data quality, integrity, and security across platforms.
  • Implement data warehousing and data lake solutions for analytics workloads.
  • Monitor and troubleshoot data infrastructure for performance and availability.

Skills

SQL
Python/Scala
Big Data
Cloud Data

Education

Bachelor's degree in CS/Engineering

Tools

Spark/Hadoop

Job description

Our client is seeking a skilled Data Engineer to join their team, focusing on building and maintaining robust data platforms that power their artificial intelligence initiatives in Upington. You will be responsible for designing, developing, and optimizing data pipelines that ingest, transform, and store large volumes of data required for machine learning and analytics. This role is critical for ensuring data availability, quality, and accessibility for our data science and AI teams, enabling them to build and deploy cutting-edge solutions.

About the Role

Our client is seeking a skilled Data Engineer to join their team, focusing on building and maintaining robust data platforms that power their artificial intelligence initiatives in Upington. You will be responsible for designing, developing, and optimizing data pipelines that ingest, transform, and store large volumes of data required for machine learning and analytics. This role is critical for ensuring data availability, quality, and accessibility for our data science and AI teams, enabling them to build and deploy cutting-edge solutions.

Key Responsibilities
  • Design, construct, install, test, and maintain highly scalable data management systems.
  • Develop and optimize data pipelines for efficient data extraction, transformation, and loading (ETL).
  • Collaborate with data scientists and AI engineers to understand their data needs and provide reliable data solutions.
  • Ensure data quality, integrity, and security across all data platforms.
  • Implement data warehousing solutions and data lakes to support analytical and AI workloads.
  • Monitor and troubleshoot data infrastructure to ensure optimal performance and availability.
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
  • 3-5 years of experience in data engineering or a similar role.
  • Proficiency in SQL and experience with relational and NoSQL databases.
  • Strong programming skills in Python or Scala.
  • Experience with big data technologies such as Spark, Hadoop, or similar frameworks.
  • Familiarity with cloud data services (e.g., AWS Redshift, S3, Azure Data Lake, Google BigQuery).
Benefits
  • Competitive salary and annual bonus opportunities.
  • Comprehensive medical aid and retirement fund benefits.
  • Opportunities for professional growth and learning new data technologies.
  • A supportive team environment focused on data innovation.
  • Generous paid time off and company holidays.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - AI Platforms
Data Engineer - AI Platforms

Placements24 • Upington

On-site
ZAR 600,000 - 900,000
Competitive salary
Medical aid
Retirement plan
+2
Senior Data Engineer - Big Data & Ai Infrastructure
Senior Data Engineer - Big Data & Ai Infrastructure

Placements24 • Johannesburg

Hybrid
ZAR 900,000 - 1,600,000
Health insurance
Retirement plans
Paid time off
+2
Senior Data Engineer: Aws Pipelines & Ai Governance
Senior Data Engineer: Aws Pipelines & Ai Governance

Jvr Software • South Africa

Hybrid
ZAR 739,000 - 1,052,000
Hybrid work arrangement
Professional development opportunities
Health and retirement benefits
+1
Ai Data Engineer - Big Data Pipelines
Ai Data Engineer - Big Data Pipelines

Placements24 • Polokwane

On-site
ZAR 600,000 - 950,000
Health insurance
Paid time off
Professional development
+1
Senior Data Engineer
Senior Data Engineer

Placements24 • Paarl

Hybrid
ZAR 900,000 - 1,200,000
Competitive salary and benefits
Health and wellness benefits
Retirement savings plan
+4
Senior Data Engineer - Big Data Platforms
Senior Data Engineer - Big Data Platforms

Placements24 • Stellenbosch

Hybrid
ZAR 900,000 - 1,300,000
Performance bonuses
Health insurance
Retirement plan
+3
Data Engineer
Data Engineer

Network Contracting • Durban

On-site
ZAR 600,000 - 1,000,000
Data Engineer: AI Platforms & Scalable Pipelines
Data Engineer: AI Platforms & Scalable Pipelines

Placements24 • Upington

On-site
ZAR 600,000 - 900,000
Competitive salary
Medical aid
Retirement plan
+2
Senior Data Engineer
Senior Data Engineer

Placements24 • East London

Hybrid
ZAR 900,000 - 1,300,000
Annual bonus
Medical aid
Retirement benefits
+5
Senior Data Engineer
Senior Data Engineer

Level Up - Your Talent Partner • Johannesburg

Hybrid
ZAR 1,000,000 - 1,800,000
Hybrid work model
Courses/mentorship opportunities
Team events