Lead Data Engineer: Azure Lakehouse & Pipelines

ScotiaTech; Colombia; Presencial; COP 100.440.000 - 156.240.000; Jornada completa

Descripción de la vacante

ScotiaTech, a unit of Scotia GBS/GSG Colombia, seeks a Data Engineer to design and optimize data pipelines on Azure Databricks and Delta Lake, enabling scalable data products for international banking.

You will lead end-to-end solution design, produce technical docs, and deliver production-grade code while mentoring a team of data engineers and collaborating with cross-functional partners.

Formación

• 2+ years of progressive hands-on experience in data engineering, including at least 3 years delivering production data solutions on Microsoft Azure and/or Azure Databricks.
• Proven experience as a technical lead on complex data initiatives with design reviews and team coaching.
• Expertise in designing and implementing data pipelines using Azure Databricks, Spark, Delta Lake, Unity Catalog, Workflows, Azure Data Factory, ADLS Gen2, Event Hubs, and Synapse.

Responsabilidades

• Design, build, test, and optimize data pipelines and lakehouse solutions on Azure and Azure Databricks to support scalable data products.
• Act as hands-on technical lead for end-to-end solution design, documentation, and production-grade code delivery.
• Lead, mentor, and develop a team of Data Engineers, including coaching, performance feedback, and hiring participation.

Conocimientos

Azure Databricks

Delta Lake

Spark

Azure Data Factory

Azure Synapse

Technical leadership

Data modeling

Herramientas

Azure Databricks

Unity Catalog

Azure Data Lake Storage Gen2

Event Hubs

Descripción del empleo

ScotiaTech, a unit of Scotia GBS/GSG Colombia, seeks a Data Engineer to design and optimize data pipelines on Azure Databricks and Delta Lake, enabling scalable data products for international banking.

You will lead end-to-end solution design, produce technical docs, and deliver production-grade code while mentoring a team of data engineers and collaborating with cross-functional partners.