Azure Data Engineering Lead — Databricks & Spark

Publicis Groupe ANZ; Bogotá ciudad; Presencial; COP 150.000.000 - 250.000.000; Jornada completa

Descripción de la vacante

Publicis Sapient in Bogotá, Colombia, is seeking a Big Data Manager / Data Engineering Lead with 8+ years of experience to design and deliver enterprise-scale, cloud-native data solutions on Microsoft Azure.

This hands-on leadership role focuses on Azure Databricks, ADLS, Apache Spark, Scala, SQL, and streaming technologies, while guiding a team of 3-4 Data Engineers and coordinating with architects, QA, and client stakeholders to translate requirements into robust data platforms.

Formación

• 8+ years of hands-on experience in Data Engineering, Big Data Engineering, Data Warehousing development, or related data-platform engineering.
• Strong hands-on expertise with Azure Databricks, Apache Spark, ADLS, Scala, and SQL.
• Proven experience designing and implementing enterprise-grade ETL/ELT pipelines.
• Strong understanding of batch and streaming architectures.
• Demonstrated experience leading and mentoring a small engineering team (3-4 Data Engineers).
• Experience translating requirements into scalable solution designs.
• Experience in Agile delivery models and CI/CD practices for data platforms.

Responsabilidades

• Design scalable Azure cloud-native data solutions and define technical approaches for batch and streaming pipelines using Azure Databricks, ADLS, Spark, Scala, and SQL.
• Lead a team of 3-4 Data Engineers, providing direction, mentoring, code reviews, and delivery coordination.
• Build and standardize reusable data engineering components for batch and streaming ingestion, transformation, data quality, and data movement across layers.
• Implement reliable Databricks and ADLS pipelines addressing performance, scalability, monitoring, and non-functional requirements.
• Collaborate with architects, analysts, QA, client stakeholders, and downstream teams to translate business needs into designs.
• Debug and optimize pipelines and codebases, drive automation, performance improvements, and cost efficiency.
• Drive engineering delivery from backlog planning through QA/UAT, production handoff, and troubleshooting.

Conocimientos

Azure Databricks

Apache Spark

ADLS

Scala

SQL

Python / PySpark

Team leadership

Descripción del empleo

Publicis Sapient in Bogotá, Colombia, is seeking a Big Data Manager / Data Engineering Lead with 8+ years of experience to design and deliver enterprise-scale, cloud-native data solutions on Microsoft Azure.

This hands-on leadership role focuses on Azure Databricks, ADLS, Apache Spark, Scala, SQL, and streaming technologies, while guiding a team of 3-4 Data Engineers and coordinating with architects, QA, and client stakeholders to translate requirements into robust data platforms.