Remote Principal Data Engineer — Lead Scalable Pipelines

Placements24; Sandton; Ibrido; ZAR 1.200.000 - 1.800.000; Tempo pieno

Vantaggi offerti da questo lavoro

Bonus structure

Health benefits

Professional development

Fully remote work

Stock options/Equity

Home office budget

Descrizione del lavoro

Placements24 is seeking a Principal Data Engineer for a remote-first role to design, build and maintain scalable data pipelines and infrastructure powering advanced analytics and AI initiatives. This senior position emphasizes leadership and hands-on technical excellence in a distributed team.

You will mentor engineers, set technical direction, collaborate with data scientists and software engineers, and champion cloud-native architectures with AWS, Azure or GCP.

Competenze

• Master's or PhD in CS/Engineering or related field, or equivalent experience.
• 8+ years in data engineering or related field.
• Proven experience with large-scale data pipelines (Spark, Flink, Kafka).
• Cloud platforms AWS/Azure/GCP and their data services (S3, Redshift, BigQuery, Snowflake, Databricks).
• Strong programming in Python, Scala or Java.
• Extensive SQL and NoSQL experience; data modeling; ETL/ELT.
• Experience with Docker/Kubernetes and CI/CD practices.
• Strong leadership and remote collaboration skills.

Mansioni

• Design, develop and optimize large-scale batch and real-time data pipelines.
• Build and maintain scalable data infrastructure using cloud-native technologies.
• Collaborate with data scientists, analysts and software engineers to meet data needs.
• Implement data governance, quality, security and performance best practices.
• Develop and manage data warehouses and data lakes.
• Evaluate and select appropriate data technologies and tools.
• Automate data processes and workflows; troubleshoot complex issues.
• Mentor junior data engineers and drive technical growth.
• Stay current with data engineering trends and big data technologies.

Conoscenze

Spark

Kafka

Python

Scala/Java

SQL/NoSQL

Cloud platforms

Docker/Kubernetes

CI/CD

Formazione

Master's or PhD or equivalent

Strumenti

Databricks

Snowflake

BigQuery

Descrizione del lavoro

Placements24 is seeking a Principal Data Engineer for a remote-first role to design, build and maintain scalable data pipelines and infrastructure powering advanced analytics and AI initiatives. This senior position emphasizes leadership and hands-on technical excellence in a distributed team.

You will mentor engineers, set technical direction, collaborate with data scientists and software engineers, and champion cloud-native architectures with AWS, Azure or GCP.