Data Engineer

Placements24; Cape Town; Hybrid; ZAR 550,000 - 900,000; Full time

Benefits offered by this job

Competitive salary

Medical and retirement benefits

Professional development

Collaborative work environment

Hybrid work arrangements

Job summary

Placements24 is seeking a proficient Data Engineer to join the analytics team in Upington. You will design, build, and maintain scalable data pipelines and infrastructure to support data warehousing, BI, and advanced analytics initiatives.

You will work with diverse data sources, ensure data quality and accessibility for downstream consumers, and collaborate with data scientists and analysts to understand their data needs. Hybrid work options available.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent experience.
• 3+ years of experience in data engineering or a related role.
• Proficiency in SQL and experience with database technologies (e.g., PostgreSQL, MySQL, Snowflake).
• Experience with big data technologies (e.g., Spark, Hadoop) and cloud platforms (AWS, Azure, GCP).
• Strong programming skills in languages like Python or Java.
• Familiarity with data modeling and data warehousing concepts.

Responsibilities

• Design, develop, and maintain robust and scalable data pipelines for ETL/ELT processes.
• Build and optimize data warehouses, data lakes, and other data storage solutions.
• Ensure data quality, integrity, and reliability across all data systems.
• Collaborate with data scientists and analysts to understand their data needs and provide support.
• Implement monitoring and alerting for data pipelines to ensure operational efficiency.
• Stay current with emerging data technologies and best practices to improve data infrastructure.

Skills

SQL

Python/Java

Data modeling

Data warehousing

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

PostgreSQL

MySQL

Snowflake

Spark

Hadoop

AWS

Azure

GCP

Job description

About the Role

Our client is seeking a proficient Data Engineer to join their analytics team in Upington. This role is essential for designing, building, and maintaining scalable data pipelines and infrastructure that support data warehousing, business intelligence, and advanced analytics initiatives. You will work with diverse data sources, ensuring data quality, accessibility, and efficiency for downstream consumers. This is an excellent opportunity for a data professional passionate about data architecture and infrastructure, looking to contribute to a data-driven organization and grow their skills in a dynamic environment.

Key Responsibilities

• Design, develop, and maintain robust and scalable data pipelines for ETL/ELT processes.
• Build and optimize data warehouses, data lakes, and other data storage solutions.
• Ensure data quality, integrity, and reliability across all data systems.
• Collaborate with data scientists and analysts to understand their data needs and provide support.
• Implement monitoring and alerting for data pipelines to ensure operational efficiency.
• Stay current with emerging data technologies and best practices to improve data infrastructure.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent experience.
• 3+ years of experience in data engineering or a related role.
• Proficiency in SQL and experience with database technologies (e.g., PostgreSQL, MySQL, Snowflake).
• Experience with big data technologies (e.g., Spark, Hadoop) and cloud platforms (AWS, Azure, GCP).
• Strong programming skills in languages like Python or Java.
• Familiarity with data modeling and data warehousing concepts.

Benefits

• Competitive salary and performance-based incentives.
• Comprehensive medical and retirement benefits.
• Opportunities for professional development and acquiring new certifications.
• A collaborative work environment with a focus on data innovation.
• Potential for hybrid work arrangements for enhanced flexibility.