Senior Data Engineer

Placements24; Benoni; Hybrid; ZAR 900,000 - 1,500,000; Full time

Benefits offered by this job

Competitive salary

Hybrid work environment

Continuous learning and development

Travel allowance for on-site days

Employer retirement savings plans

Job summary

Placements24 is seeking an experienced Senior Data Engineer to design and maintain scalable data pipelines in a hybrid work model based in Benoni, Gauteng. You will work with data scientists and engineers to ensure data availability, quality, and performance across cloud platforms.

The ideal candidate has 6+ years in data engineering, strong SQL, Spark, Kafka, and cloud experience (AWS/Azure/GCP). You will mentor junior engineers and help build robust data infrastructure for analytics and ML

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related quantitative field
• 6+ years of professional data engineering experience
• Experience designing large-scale data pipelines with Spark, Kafka or similar
• Strong SQL and relational + NoSQL database experience
• Hands-on with cloud data services (AWS/Azure/GCP)
• Programming in Python or Scala
• Familiar with data warehousing concepts and dimensional modeling
• Knowledge of data governance, quality, and security principles
• Excellent problem-solving and collaborative skills
• Hybrid work environment experience preferred

Responsibilities

• Design, develop, and optimize robust ETL/ELT pipelines
• Build and maintain data warehouses and data lakes on cloud platforms
• Implement data governance, quality, and security best practices
• Collaborate with data scientists and analysts to meet data needs
• Develop and manage scalable data infrastructure for reliability
• Automate data processes and monitor pipeline health
• Stay updated on emerging data engineering technologies
• Troubleshoot data pipelines and infrastructure issues
• Document data architectures, pipelines, and processes
• Mentor junior data engineers and promote knowledge sharing

Skills

SQL

Python

Apache Spark

Kafka

ETL/ELT

Data warehousing

Data governance

Communication

Education

Bachelor's degree in CS/Engineering

Tools

Apache Spark

Kafka

PostgreSQL

MySQL

AWS S3

Redshift

Azure Data Lake

GCP BigQuery

Python

Job description

About the Role

Our client, a leading financial technology firm, is seeking an experienced Senior Data Engineer to join their dynamic team in Benoni, Gauteng . This hybrid role allows for a balance of remote work and on-site collaboration at our state-of-the-art offices in Benoni . You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support the company's data analytics and machine learning initiatives. The ideal candidate will have a strong background in data warehousing, ETL processes, big data technologies, and cloud platforms. You will work closely with data scientists, analysts, and software engineers to ensure data availability, quality, and performance. This role is critical in enabling data-driven decision-making across the organization.

Key Responsibilities

• Design, develop, and optimize robust and scalable ETL/ELT pipelines.
• Build and maintain data warehouses and data lakes on cloud platforms (e.g., AWS, Azure, GCP).
• Implement data governance, quality, and security best practices.
• Collaborate with data scientists and analysts to understand their data needs and provide solutions.
• Develop and manage data infrastructure, ensuring reliability and performance.
• Automate data processes and monitor pipeline health.
• Stay current with emerging technologies and trends in data engineering.
• Troubleshoot and resolve issues related to data pipelines and infrastructure.
• Document data architectures, pipelines, and processes.
• Mentor junior data engineers and promote knowledge sharing.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• A minimum of 6 years of professional experience in data engineering or a related role.
• Proven experience designing and implementing large-scale data pipelines using tools like Apache Spark, Kafka, or similar technologies.
• Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases.
• Hands-on experience with cloud data services (e.g., AWS S3, Redshift, Glue; Azure Data Lake, Synapse; GCP BigQuery, Dataflow).
• Experience with programming languages commonly used in data engineering (e.g., Python, Scala).
• Familiarity with data warehousing concepts and dimensional modeling.
• Strong understanding of data governance, data quality, and data security principles.
• Excellent problem-solving and analytical skills.
• Effective communication and collaboration skills, with the ability to work in a hybrid team environment.

Benefits

• Our client offers a competitive salary commensurate with experience and a performance-based bonus structure.
• Comprehensive health, dental, and vision insurance plans are provided.
• Generous paid time off, including vacation, sick leave, and public holidays, ensures work-life balance.
• Opportunities for continuous learning and professional development are supported through training programs, certifications, and conference attendance.
• Employees benefit from exposure to challenging projects within the FinTech industry and a collaborative hybrid work environment.
• A travel allowance may be provided for required on-site days in Benoni .
• Retirement savings plans with employer matching are available.
• We are committed to fostering a diverse and inclusive workplace.