Remote Lead Data Engineer (Big Data & AI Platforms)

Placements24; Benoni; Híbrido; ZAR 2.334.000 - 3.334.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

High salary & bonuses

Home office stipend

Professional development budget

Global remote team

Descripción de la vacante

Placements24 is seeking a highly experienced Lead Data Engineer for a fully remote role. You will design and manage scalable data pipelines and cloud platforms to power AI and analytics initiatives, guiding a team of data engineers and collaborating with data scientists.

The role emphasizes data governance, quality, and security, with opportunities for professional development and a strong compensation package. You will work in a remote-first environment with global teams.

Formación

• Master's degree or higher in a quantitative field.
• 8+ years in data engineering with 3+ years in lead roles.
• Experience designing large-scale data pipelines with Spark, Kafka, Flink.
• Proficiency with cloud data services and data warehousing concepts.
• Experience with Docker, Kubernetes, and IaC tooling.

Responsabilidades

• Lead design and implementation of scalable data pipelines.
• Architect and manage cloud-based data platforms optimized for AI workloads.
• Oversee data warehousing, data lakes, and ETL/ELT processes.
• Mentor data engineers and collaborate with data scientists.
• Ensure data quality, security, and governance across platforms.
• Drive performance, cost-efficiency, and scalability strategies.

Conocimientos

Leadership

Data engineering

Cloud platforms

Big data

MLOps

SQL

NoSQL

Containerization

Terraform

Kubernetes

Spark

Kafka

Flink

Educación

Master's degree in Computer Science / Engineering / Data Science

Herramientas

AWS

Azure

GCP

Redshift

BigQuery

Snowflake

S3

ADLS

Descripción del empleo

About the Role

Join a globally recognized leader in AI innovation as a Remote Lead Data Engineer. This fully remote position offers the unparalleled opportunity to design, build, and manage the sophisticated big data and AI platforms that power our cutting-edge technologies. Our client is at the forefront of AI research and application, and you will play a pivotal role in ensuring the reliability, scalability, and efficiency of our data infrastructure. You will lead a team of talented data engineers, mentor junior members, and collaborate closely with data scientists and AI researchers to enable advanced analytics and machine learning initiatives. The ideal candidate has extensive experience with large-scale data systems, cloud platforms, and data engineering best practices, combined with strong leadership capabilities. If you are passionate about building robust data foundations for AI and thrive in a collaborative, remote-first environment, this is the perfect opportunity for you to make a significant impact.

Key Responsibilities

• Lead the design, development, and implementation of scalable and robust data pipelines for big data and AI workloads.
• Architect and manage cloud-based data platforms (e.g., AWS, Azure, GCP) optimized for AI and machine learning.
• Oversee the implementation of data warehousing, data lakes, and ETL/ELT processes.
• Mentor and guide a team of data engineers, fostering best practices and technical excellence.
• Collaborate with data scientists and AI researchers to understand their data needs and provide efficient solutions.
• Ensure data quality, integrity, and security across all data platforms.
• Optimize data infrastructure for performance, cost-efficiency, and scalability.
• Stay abreast of emerging technologies and trends in big data, cloud computing, and AI data engineering.
• Develop and enforce data governance policies and procedures.

Requirements

• Master’s degree or higher in Computer Science, Engineering, Data Science, or a related quantitative field.
• 8+ years of progressive experience in data engineering, with at least 3 years in a lead or senior role.
• Extensive experience designing and building large-scale data pipelines using technologies such as Spark, Kafka, Flink, or similar.
• Proficiency with cloud data services (e.g., S3, ADLS, GCS, Redshift, BigQuery, Snowflake).
• Strong understanding of data warehousing concepts, data modeling, and database technologies (SQL and NoSQL).
• Experience with containerization (Docker, Kubernetes) and infrastructure as code (Terraform, CloudFormation).
• Proven leadership skills with experience mentoring and managing engineering teams.
• Excellent problem-solving, analytical, and communication skills.
• Familiarity with MLOps principles and tools is a strong advantage.
• Experience working in a remote, collaborative environment is preferred.

Benefits

• This fully remote position offers an exceptional salary, generous performance bonuses, and a comprehensive benefits package including top-tier health insurance, retirement contributions, and extensive paid time off.
• Enjoy the flexibility and autonomy of working from anywhere, with a dedicated home office stipend.
• Our client provides a significant budget for professional development, including access to online courses, conferences, and certifications.
• You’ll be part of a dynamic, innovative culture, collaborating with a global team of experts on the cutting edge of AI and big data technologies, with ample opportunities for career advancement.