Remote Lead Data Engineer: Architect Data Pipelines

Placements24; Sandton; Híbrido; ZAR 1 200 000 - 1 800 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Performance bonuses

Health insurance

Retirement plan

Paid time off

Remote work with flexible hours

Professional development budget

Conferences access

Access to advanced data tooling

Resumo da oferta

Placements24 is seeking a Lead Data Engineer to architect and build robust data pipelines and infrastructure in a fully remote role. You will lead a team, design scalable data solutions, and ensure data flows support analysts and scientists across the organization.

You will leverage Spark, Kafka, and cloud data platforms to deliver high-availability data services, while mentoring junior engineers and driving best-practices in governance and security. Remote-first culture emphasized.

Qualificações

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• Minimum 7 years in data engineering with lead/architect experience.
• Proven design of large-scale data pipelines using Spark, Kafka, Flink, etc.
• Proficient in Python, Scala, or Java; strong SQL and various DB technologies.
• Experience with cloud data platforms (AWS/Azure/GCP) and data warehousing concepts.
• Familiar with Docker/Kubernetes; CI/CD is a plus.
• Excellent leadership and communication skills; remote-work capable.

Responsabilidades

• Lead design, development, and maintenance of scalable data pipelines and ETL/ELT processes.
• Architect data warehousing and data lake strategies.
• Develop data infrastructure with high availability, performance, and security.
• Collaborate with data scientists, analysts and stakeholders to meet data needs.
• Define and enforce data governance policies and best practices.
• Optimize data processing workflows and query performance.
• Select and implement data technologies and tools.
• Mentor junior data engineers and promote technical excellence.
• Monitor systems, identify issues, and implement solutions.
• Stay current with emerging data engineering trends and tools.

Conhecimentos

Leadership

Data governance

Python/Scala/Java

SQL

Cloud platforms

Spark/Kafka/Flink

Data warehousing

Docker/Kubernetes

CI/CD

Remote collaboration

Formação académica

Bachelor's or Master's in CS/Engineering

Ferramentas

S3/Redshift/BigQuery/Snowflake

Descrição da oferta de emprego

Placements24 is seeking a Lead Data Engineer to architect and build robust data pipelines and infrastructure in a fully remote role. You will lead a team, design scalable data solutions, and ensure data flows support analysts and scientists across the organization.

You will leverage Spark, Kafka, and cloud data platforms to deliver high-availability data services, while mentoring junior engineers and driving best-practices in governance and security. Remote-first culture emphasized.