Remote Lead Data Engineer: Big Data & Analytics Architect

Placements24; Gauteng; Híbrido; ZAR 1.996.000 - 2.995.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Competitive compensation

Full remote work

Learning and development opportunities

Stock options or equity (if offered)

Access to latest Big Data tools

Descripción de la vacante

Placements24 is seeking a visionary Lead Data Engineer for a cutting-edge data analytics firm. This fully remote role focuses on architecting, building, and maintaining scalable data pipelines and infrastructure to enable advanced analytics and ML initiatives.

You will lead a team of data engineers, driving innovation across the data platform. You will work with Spark, Hadoop, Kafka, and cloud platforms, mentor teammates, ensure data quality and security, and collaborate with data scientists and

Formación

• Master's or Bachelor's degree in CS, Eng, or related quantitative field.
• 5+ years in data engineering with Big Data focus.
• Experience designing data pipelines with Spark.
• Knowledge of Hadoop, Hive, HDFS, Kafka.
• Proficient in Python, Scala or Java; strong SQL and DB skills.
• Experience with cloud data platforms (AWS, Azure, GCP).
• Familiar with data warehousing concepts and data modelling.
• Excellent leadership, problem-solving, and communication skills.
• Ability to work remotely and collaborate across disciplines.

Responsabilidades

• Lead design, development, and optimization of large-scale data pipelines.
• Build scalable, fault-tolerant data infrastructure using Spark, Hadoop, Kafka.
• Develop data warehousing and data lakes solutions.
• Implement ETL/ELT processes from diverse sources.
• Ensure data quality, integrity, and security across systems.
• Collaborate with data scientists, analysts, and software engineers.
• Mentor junior data engineers and promote best practices.
• Automate data processes and monitor system performance.
• Stay current with emerging Big Data technologies and practices.

Conocimientos

Leadership

Remote collaboration

Communication

Problem solving

Mentorship

Educación

Master's degree in Computer Science / Engineering

Bachelor's degree in Computer Science / Engineering

Herramientas

Apache Spark

Hadoop ecosystem

Kafka

Python

Scala

Java

SQL

Relational & NoSQL databases

AWS

Azure

GCP

Descripción del empleo

Placements24 is seeking a visionary Lead Data Engineer for a cutting-edge data analytics firm. This fully remote role focuses on architecting, building, and maintaining scalable data pipelines and infrastructure to enable advanced analytics and ML initiatives.

You will lead a team of data engineers, driving innovation across the data platform. You will work with Spark, Hadoop, Kafka, and cloud platforms, mentor teammates, ensure data quality and security, and collaborate with data scientists and