Senior Data Engineer - Financial Data Pipelines & Cloud

Capitec Ltd

South Africa

Presencial

ZAR 900.000 - 1.300.000

Jornada completa

hace 44 horas
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Competitive salary
Health benefits
Retirement savings plan
Professional development
Conference attendance
Flexible working

Descripción de la vacante

Capitec Ltd seeks a Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure for advanced analytics. You will work with large datasets, leveraging Spark, Hadoop, and cloud services to deliver high-quality data for data scientists and analysts.

Strong SQL, Python/Scala/Java skills, and data warehousing experience are essential. The role emphasizes data quality, security, and collaboration with stakeholders to enable data-driven decision-making across the

Formación

  • Bachelor's degree in Computer Science, Engineering, or related quantitative field.
  • 5+ years of professional data engineering experience.
  • Experience designing and implementing complex data pipelines and ETL processes.
  • Proficiency in Python, Scala, or Java.
  • Strong SQL skills with relational and NoSQL databases.
  • Hands-on experience with Spark and Hadoop ecosystems.
  • Experience with cloud data platforms (AWS, Azure, GCP).
  • Familiarity with data warehousing concepts and tools.
  • Experience with Airflow is a plus.

Responsabilidades

  • Design, build, and maintain robust, scalable data pipelines and infrastructure.
  • Develop and optimize data warehousing solutions and data lakes.
  • Implement data quality frameworks ensuring data accuracy and completeness.
  • Collaborate with data scientists and analysts to meet data needs.
  • Work with Spark, Hadoop, and cloud-based data services.
  • Automate data processes and monitor pipeline performance.
  • Ensure data security and regulatory compliance.
  • Optimize database performance and manage database systems.
  • Document data processes, architecture, and metadata.
  • Stay updated with latest data engineering technologies.

Conocimientos

Python
SQL
Java
Scala
NoSQL
ETL/ELT design

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Apache Spark
Hadoop
Airflow
AWS S3/Redshift/EMR
Azure Data Lake/Databricks
GCP BigQuery/Dataflow

Descripción del empleo

Our client, a leading analytics and insights firm, is seeking a Senior Data Engineer to join their expanding data platform team. This critical role is based in the picturesque and technologically active city of Paarl, Western Cape. The successful candidate will be responsible for designing, building, and maintaining scalable and efficient data pipelines and infrastructure that support the company's advanced analytics and machine learning initiatives. You will work with large, complex datasets, employing cutting-edge technologies to ensure data quality, availability, and accessibility for data scientists and analysts. We are looking for an experienced professional with a passion for data architecture, a strong command of ETL processes, and a commitment to enabling data-driven decision-making across the organization.

Key Responsibilities
  • Design, build, and maintain robust, scalable, and reliable data pipelines using various ETL/ELT tools and technologies.
  • Develop and optimize data warehousing solutions and data lakes.
  • Implement data quality frameworks and ensure data accuracy, consistency, and completeness.
  • Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and provide solutions.
  • Work with big data technologies such as Spark, Hadoop, and cloud-based data services (AWS, Azure, GCP).
  • Automate data processes and monitor pipeline performance for efficiency and reliability.
  • Ensure data security and compliance with relevant regulations.
  • Optimize database performance and manage database systems.
  • Stay updated with the latest trends and technologies in data engineering.
  • Document data processes, architecture, and metadata.
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent practical experience.
  • 5+ years of professional experience in data engineering or a related role.
  • Proven experience designing and implementing complex data pipelines and ETL processes.
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Strong experience with SQL and working with relational and NoSQL databases.
  • Hands-on experience with big data technologies (e.g., Apache Spark, Hadoop ecosystem).
  • Experience with cloud data platforms (AWS S3, Redshift, EMR; Azure Data Lake, Databricks; GCP BigQuery, Dataflow).
  • Familiarity with data warehousing concepts and tools.
  • Experience with workflow management tools like Airflow is a plus.
  • Excellent problem-solving, analytical, and communication skills.
Benefits

Our client offers a competitive salary, comprehensive health and wellness benefits, and a retirement savings plan. Opportunities for professional development, including training, certifications, and conference attendance, are readily available. You will join a collaborative and innovative team in the beautiful region of Paarl, Western Cape, working on impactful data projects. The company culture promotes work-life balance, offering flexible working arrangements. Performance bonuses and generous paid time off are also part of the attractive package, ensuring a rewarding career experience.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Data Engineer
Senior Data Engineer

Placements24 • Paarl

Híbrido
ZAR 900.000 - 1.200.000
Competitive salary and benefits
Health and wellness benefits
Retirement savings plan
+4
Senior Data Engineer
Senior Data Engineer

Placements24 • Vereeniging

Presencial
ZAR 700.000 - 1.100.000
Competitive salary package and bonus
Comprehensive health, dental, and退休/RE
Opportunities for professional develop
Senior Data Engineer - Big Data Platforms
Senior Data Engineer - Big Data Platforms

Placements24 • Stellenbosch

Híbrido
ZAR 900.000 - 1.300.000
Performance bonuses
Health insurance
Retirement plan
+3
Senior Data Engineer
Senior Data Engineer

Placements24 • Bloemfontein

Híbrido
ZAR 1.000.000 - 1.600.000
Competitive salary
Medical aid and retirement fund
Professional development and certific=fi
Senior Data Engineer
Senior Data Engineer

Placements24 • East London

Híbrido
ZAR 900.000 - 1.300.000
Annual bonus
Medical aid
Retirement benefits
+5
Data Engineer - Big Data Platforms
Data Engineer - Big Data Platforms

Placements24 • Stellenbosch Local Municipality

Híbrido
ZAR 480.000 - 800.000
Medical aid
Provident fund
Paid vacation time
+2
Senior Data Engineer (Big Data Platforms)
Senior Data Engineer (Big Data Platforms)

Placements24 • Pretoria

Híbrido
ZAR 900.000 - 1.500.000
Hybrid work model
Professional development opportunities
Conferences and training
Senior Data Engineer (Big Data Technologies)
Senior Data Engineer (Big Data Technologies)

Placements24 • Upington

Presencial
ZAR 900.000 - 1.200.000
Competitive salary
In-office Upington location
Professional development
+2
Principal Data Engineer
Principal Data Engineer

Placements24 • Stellenbosch

Híbrido
ZAR 1.500.000 - 2.500.000
Health insurance
Retirement contributions
Life assurance
+4
Senior Data Engineer - Financial Systems
Senior Data Engineer - Financial Systems

Placements24 • Soweto

Híbrido
ZAR 900.000 - 1.500.000
Fully remote work
Competitive salary with bonuses
Health & wellness benefits
+4