Senior Data Engineer

Placements24; Bloemfontein; Híbrido; ZAR 1.000.000 - 1.600.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Competitive salary

Medical aid and retirement fund

Professional development and certific=fi

Descripción de la vacante

Placements24 seeks a seasoned Senior Data Engineer to join its data platform team in Bloemfontein.

You will design, develop, and optimize scalable data pipelines, ensuring data quality and reliable access for data scientists and analysts in a hybrid work setting.

Formación

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
• 5+ years of professional experience in data engineering or a related role.
• Proven experience designing and implementing large-scale data pipelines using big data technologies (e.g., Spark, Hadoop, Kafka).
• Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL) and data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services.
• Proficiency in programming languages such as Python or Scala for data manipulation and scripting.
• Experience with ETL/ELT tools and techniques.
• Understanding of data modeling concepts and best practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Experience in a hybrid work setting is preferred.

Responsabilidades

• Design, build, and maintain scalable data pipelines for batch and real-time data processing.
• Develop and manage ETL/ELT processes to ingest, transform, and load data into data warehouses and data lakes.
• Optimize data infrastructure and query performance for efficiency and scalability.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide solutions.
• Implement data governance and data quality best practices to ensure data accuracy and consistency.
• Develop and maintain data models for analytical and reporting purposes.
• Troubleshoot and resolve data-related issues in production environments.
• Evaluate and recommend new technologies and tools to improve the data platform.
• Ensure the security and compliance of data storage and processing.
• Document data pipelines, processes, and data dictionaries.

Conocimientos

Data engineering

SQL proficiency

Python/Scala

Problem solving

Communication

Collaboration

Hybrid work experience

Educación

Bachelor's degree in CS/Engineering/IT

Herramientas

Spark

Hadoop

Kafka

Snowflake

Redshift

BigQuery

AWS

Azure

GCP

ETL/ELT tools

Descripción del empleo

About the Role

Our client, a rapidly expanding fintech company, is seeking a seasoned Senior Data Engineer to join their data platform team in Bloemfontein. This role is crucial for building and maintaining the robust data infrastructure that powers our client's innovative financial products and services. You will be responsible for designing, developing, and optimizing scalable data pipelines, ensuring data quality, and supporting data scientists and analysts with reliable data access. The ideal candidate will have extensive experience with big data technologies, cloud platforms, and ETL/ELT processes. This hybrid position allows for a blend of on-site collaboration at our client's Bloemfontein, Free State office and remote flexibility, offering a balanced work environment.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for batch and real-time data processing.
• Develop and manage ETL/ELT processes to ingest, transform, and load data from various sources into data warehouses and data lakes.
• Optimize data infrastructure and query performance for efficiency and scalability.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide solutions.
• Implement data governance and data quality best practices to ensure data accuracy and consistency.
• Develop and maintain data models for analytical and reporting purposes.
• Troubleshoot and resolve data-related issues in production environments.
• Evaluate and recommend new technologies and tools to improve the data platform.
• Ensure the security and compliance of data storage and processing.
• Document data pipelines, processes, and data dictionaries.

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
• 5+ years of professional experience in data engineering or a related role.
• Proven experience designing and implementing large-scale data pipelines using big data technologies (e.g., Spark, Hadoop, Kafka).
• Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL) and data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services.
• Proficiency in programming languages such as Python or Scala for data manipulation and scripting.
• Experience with ETL/ELT tools and techniques.
• Understanding of data modeling concepts and best practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Experience in a hybrid work setting is preferred.

Benefits

• Competitive salary
• Medical aid and retirement fund
• Professional development and certifications
• Supportive team environment

This hybrid role in Bloemfontein provides the perfect balance between working at a modern office and enjoying remote flexibility, allowing you to contribute to a growing fintech leader. Join us and shape the future of data at our client.