Senior Data Engineer

Placements24; LegKraal Gate; Hybrid; ZAR 900,000 - 1,500,000; Full time

Benefits offered by this job

Competitive salary

Annual bonus

Health coverage

Employer matching retirement

Professional development

Fully remote from Mahikeng

Job summary

Placements24 is seeking an experienced Senior Data Engineer to join our growing data platform team in Mahikeng. This role focuses on designing, building, and maintaining robust data pipelines and infrastructure that support analytics and ML initiatives.

You will work with large-scale datasets, ensure data quality and accessibility, and collaborate with data scientists and analysts to deliver data-driven insights. Proficiency in cloud data solutions and data warehousing is essential.

Qualifications

• 5+ years of experience in data engineering or related role.
• Strong proficiency in SQL and experience with relational and NoSQL databases.
• Expertise in programming languages such as Python or Scala for data manipulation and pipeline development.
• Hands-on experience with cloud data platforms and big data technologies (e.g., Spark, Hadoop).
• Experience with ETL tools and data warehousing concepts.

Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines for ingesting and transforming data from various sources.
• Develop and maintain data warehouses and data lakes using cloud technologies (e.g., AWS Redshift, Snowflake, BigQuery).
• Ensure data quality, integrity, and consistency across all data platforms.
• Collaborate with data scientists and analysts to understand their data needs and provide efficient data solutions.
• Implement data governance and security best practices.
• Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness.

Skills

SQL

Python/Scala

Relational/NoSQL databases

Spark/Hadoop

ETL tools

Data warehousing

Education

Bachelor's degree in Computer Science or related field

Tools

AWS Redshift

Snowflake

BigQuery

Job description

About the Role

Our client is seeking an experienced Senior Data Engineer to join their growing data platform team in Mahikeng . This role is critical for designing, building, and maintaining robust data pipelines and infrastructure that support the organization's data analytics and machine learning initiatives. You will work with large-scale datasets, ensuring data quality, reliability, and accessibility. The ideal candidate is proficient in data warehousing, ETL processes, and cloud-based data solutions, with a passion for enabling data-driven insights.

Key Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines for ingesting and transforming data from various sources.
• Develop and maintain data warehouses and data lakes using cloud technologies (e.g., AWS Redshift , Snowflake , BigQuery ).
• Ensure data quality, integrity, and consistency across all data platforms.
• Collaborate with data scientists and analysts to understand their data needs and provide efficient data solutions.
• Implement data governance and security best practices.
• Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in data engineering or a related role.
• Strong proficiency in SQL and experience with relational and NoSQL databases.
• Expertise in programming languages such as Python or Scala for data manipulation and pipeline development.
• Hands-on experience with cloud data platforms and big data technologies (e.g., Spark, Hadoop).
• Experience with ETL tools and data warehousing concepts.

Benefits

• Competitive salary and annual bonus structure.
• Comprehensive health, dental, and vision coverage.
• Retirement savings plan with employer matching.
• Opportunities for professional development and training in data technologies.
• A fully remote work environment, offering maximum flexibility, based out of Mahikeng .
• Work on challenging projects involving big data and cutting-edge analytics tools.