Data Engineer

Placements24; Randburg; Hybrid; ZAR 900,000 - 1,200,000; Full time

Benefits offered by this job

Competitive salary

Health benefits

Training & conferences

Hybrid work model

Job summary

Placements24 is seeking a skilled Data Engineer for a hybrid role in Randburg, Gauteng. You will design, build, and maintain data pipelines, data warehouses, and data lakes to support advanced analytics and ML initiatives.

Key duties include implementing ETL processes, ensuring data quality and security, and collaborating with data scientists and analysts to deliver robust data solutions. A strong background in data architecture and programming is required.

Qualifications

• Proven experience as a Data Engineer or similar role.
• Strong SQL skills and experience with relational databases.
• Experience with NoSQL databases is a plus.
• Proficient in Python, Scala or Java for data pipelines.
• Experience with ETL tools and data warehousing concepts.
• Familiarity with big data technologies (Spark, Hadoop).
• Experience with cloud data services (AWS/Azure/GCP).
• Knowledge of data modeling techniques.

Responsibilities

• Design, build and maintain scalable data pipelines for ingestion, transformation and processing.
• Develop and optimize ETL processes using appropriate tools.
• Build and manage data warehouses and data lakes with integrity and accessibility.
• Implement data quality checks and monitoring systems.
• Collaborate with data scientists and analysts to meet data needs.
• Develop and maintain database schemas and performance tuning strategies.
• Automate data processes to improve efficiency.
• Stay current with emerging data technologies and best practices.
• Ensure data security and regulatory compliance.
• Contribute to architectural decisions regarding data infrastructure.

Skills

SQL

Relational DBs

NoSQL

Python

Scala

Java

ETL tooling

Data warehousing

Big data

Cloud platforms

Data modeling

Communication

Education

Bachelor's degree in Computer Science or Engineering

Tools

PostgreSQL

MongoDB

MySQL

Spark

Hadoop

Job description

About the Role

Our client, a fast-growing analytics firm, is seeking a skilled and experienced Data Engineer to join their innovative team in Randburg, Gauteng. This hybrid role involves designing, building, and maintaining robust data pipelines and infrastructure that support the company's advanced analytics and machine learning initiatives. You will work with large datasets, implement data warehousing solutions, and ensure data quality and accessibility for data scientists and analysts. We are looking for individuals with a strong background in data architecture, ETL processes, and database management. The ideal candidate is passionate about data, efficient systems, and thrives in a collaborative environment where they can contribute to solving complex data challenges. This is an exciting opportunity to play a key role in shaping our client's data capabilities within the vibrant tech hub of Randburg, Gauteng.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for data ingestion, transformation, and processing.
• Develop and optimize ETL (Extract, Transform, Load) processes using appropriate tools and technologies.
• Build and manage data warehouses and data lakes, ensuring data integrity and accessibility.
• Implement data quality checks and monitoring systems to ensure data accuracy and consistency.
• Collaborate with data scientists and analysts to understand their data needs and provide solutions.
• Develop and maintain database schemas and performance tuning strategies.
• Automate data processes to improve efficiency and reduce manual intervention.
• Stay current with emerging data technologies and best practices.
• Ensure data security and compliance with relevant regulations.
• Contribute to architectural decisions regarding data infrastructure.

Requirements

• Proven experience as a Data Engineer or in a similar role, with a strong portfolio of data solutions.
• Proficiency in SQL and experience with relational database systems (e.g., PostgreSQL, MySQL, SQL Server).
• Experience with NoSQL databases (e.g., MongoDB, Cassandra) is a plus.
• Strong programming skills in languages like Python, Scala, or Java for data manipulation and pipeline development.
• Experience with ETL tools and data warehousing concepts.
• Familiarity with big data technologies such as Spark, Hadoop, or related ecosystems.
• Experience with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data modeling techniques.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent experience.

Benefits

• Competitive salary.
• Comprehensive health benefits.
• Retirement savings plan.
• Significant opportunities for professional growth, including training, certifications, and conference attendance.
• Hybrid role offers a balance of in-office collaboration and remote work flexibility.
• Modern office environment in Randburg, Gauteng, with a team of dedicated professionals focused on leveraging data for business impact.
• Culture of innovation, continuous learning, and career development.