Hybrid Data Engineer - Pipelines & Data Quality

Placements24; Randburg; Ibrido; ZAR 900.000 - 1.200.000; Tempo pieno

Vantaggi offerti da questo lavoro

Competitive salary

Health benefits

Training & conferences

Hybrid work model

Descrizione del lavoro

Placements24 is seeking a skilled Data Engineer for a hybrid role in Randburg, Gauteng. You will design, build, and maintain data pipelines, data warehouses, and data lakes to support advanced analytics and ML initiatives.

Key duties include implementing ETL processes, ensuring data quality and security, and collaborating with data scientists and analysts to deliver robust data solutions. A strong background in data architecture and programming is required.

Competenze

• Proven experience as a Data Engineer or similar role.
• Strong SQL skills and experience with relational databases.
• Experience with NoSQL databases is a plus.
• Proficient in Python, Scala or Java for data pipelines.
• Experience with ETL tools and data warehousing concepts.
• Familiarity with big data technologies (Spark, Hadoop).
• Experience with cloud data services (AWS/Azure/GCP).
• Knowledge of data modeling techniques.

Mansioni

• Design, build and maintain scalable data pipelines for ingestion, transformation and processing.
• Develop and optimize ETL processes using appropriate tools.
• Build and manage data warehouses and data lakes with integrity and accessibility.
• Implement data quality checks and monitoring systems.
• Collaborate with data scientists and analysts to meet data needs.
• Develop and maintain database schemas and performance tuning strategies.
• Automate data processes to improve efficiency.
• Stay current with emerging data technologies and best practices.
• Ensure data security and regulatory compliance.
• Contribute to architectural decisions regarding data infrastructure.

Conoscenze

SQL

Relational DBs

NoSQL

Python

Scala

Java

ETL tooling

Data warehousing

Big data

Cloud platforms

Data modeling

Communication

Formazione

Bachelor's degree in Computer Science or Engineering

Strumenti

PostgreSQL

MongoDB

MySQL

Spark

Hadoop

Descrizione del lavoro

Placements24 is seeking a skilled Data Engineer for a hybrid role in Randburg, Gauteng. You will design, build, and maintain data pipelines, data warehouses, and data lakes to support advanced analytics and ML initiatives.

Key duties include implementing ETL processes, ensuring data quality and security, and collaborating with data scientists and analysts to deliver robust data solutions. A strong background in data architecture and programming is required.