Senior Data Engineer

Placements24; Mtubatuba Local Municipality; Hybrid; ZAR 900,000 - 1,400,000; Full time

Benefits offered by this job

Remote work stipend

Health benefits

Flexible schedule

Professional development

Job summary

Placements24 is seeking a Senior Data Engineer to join a fully remote data analytics team in South Africa. You will design, build, and maintain scalable data pipelines and infrastructure powering analytics and ML models.

Strong SQL, Python/Scala, and cloud data services are required to deliver robust data solutions. You will collaborate with data scientists, analysts and stakeholders, ensure data quality, and mentor junior engineers in a remote, flexible environment.

Qualifications

• Bachelor's or Master's in CS, Engineering, or related quantitative field.
• 5+ years in data engineering or a similar role.
• Experience with cloud data services and big data technologies.

Responsibilities

• Design, develop, and maintain scalable data pipelines for batch and real-time processing.
• Build and optimize data warehouses and data lakes.
• Implement ETL/ELT processes to ingest, transform, and load data.
• Ensure data quality, integrity, and consistency across data systems.
• Collaborate with data scientists and analysts to provide clean data for analysis and models.
• Develop and manage data infrastructure using cloud services (AWS/Azure/GCP).
• Implement monitoring and alerting for data pipelines to detect issues quickly.
• Optimize data query performance and data access patterns.
• Stay up-to-date with new data engineering technologies and best practices.
• Mentor junior data engineers and contribute to the team's growth.

Skills

SQL

Python/Scala

Data warehousing

Analytical thinking

Remote collaboration

Education

Bachelor's or Master’s in CS/Engineering

Tools

Spark

Hadoop

Kafka

PostgreSQL

MySQL

AWS

Azure

GCP

Redshift

Glue

BigQuery

Job description

About the Role

Our client, a rapidly growing data analytics firm, is seeking an exceptional Senior Data Engineer to join their fully remote team. This is a unique opportunity to design, build, and maintain scalable data pipelines and infrastructure that power advanced analytics and machine learning models. You will work with large, complex datasets, leveraging cutting-edge technologies to ensure data quality, accessibility, and efficiency. The ideal candidate possesses a strong understanding of data warehousing, ETL processes, and distributed data systems. You will collaborate closely with data scientists, analysts, and business stakeholders to understand data needs and deliver robust data solutions. If you are passionate about data, thrive in a remote collaborative environment, and are eager to tackle challenging data problems, this role is for you. We are committed to fostering a culture of innovation and providing our remote employees with the tools and support needed to excel. This position is instrumental in enabling data-driven decision-making across the organization.

Key Responsibilities

• Design, develop, and maintain scalable and reliable data pipelines for batch and real-time data processing.
• Build and optimize data warehouses, data lakes, and other data storage solutions.
• Implement ETL/ELT processes to ingest, transform, and load data from various sources.
• Ensure data quality, integrity, and consistency across all data systems.
• Collaborate with data scientists and analysts to provide clean, structured data for analysis and model building.
• Develop and manage data infrastructure using cloud services (e.g., AWS, Azure, GCP ).
• Implement monitoring and alerting for data pipelines to ensure timely issue detection and resolution.
• Optimize data query performance and data access patterns.
• Stay up-to-date with emerging data engineering technologies and best practices.
• Mentor junior data engineers and contribute to the team's technical growth.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in data engineering or a similar role.
• Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
• Experience with big data technologies such as Spark, Hadoop, or Kafka .
• Proficiency in programming languages like Python or Scala .
• Experience with cloud data services (e.g., AWS S3, Redshift, Glue; Azure Data Lake, Synapse; GCP BigQuery, Dataflow ).
• Familiarity with data warehousing concepts and Kimball/Inmon methodologies.
• Experience with ETL/ELT tools and frameworks.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills, essential for a remote team environment.

Benefits

Our client offers a highly competitive salary, comprehensive health benefits, generous paid time off, a remote work stipend, opportunities for professional development and conference attendance, and a collaborative and innovative work culture. As a fully remote position, you will enjoy flexibility in your work schedule and the ability to work from anywhere within South Africa. We value our employees and are dedicated to fostering a supportive environment where you can grow your career and make a significant impact on our data-driven initiatives.