Azure Databricks Data Engineering Lead - Global Banking

ScotiaTech; Colombia; Presencial; COP 180.000.000 - 320.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Multicultural environment

Well-being benefits

Competitive wages

Descripción de la vacante

Scotiatech is seeking a Senior Data Engineer Lead to design, build, and optimize data pipelines on Azure Databricks for its International Banking initiatives. You will lead a team, deliver production-grade code, and ensure data governance and security across cloud environments.

The role requires strong Python, PySpark, and SQL skills, plus experience in leading complex data projects and collaborating with cross-functional teams. Fluency in English is required; Spanish is a plus.

Formación

• Bachelor’s degree in Computer Science, Data Engineering, IT or related field.
• Master’s degree is asset.
• 5+ years in data engineering with 3+ years on Azure/Azure Databricks.
• Strong lead experience: design reviews, coaching, and supervision.
• Proficient in Python, PySpark, SQL; Scala/Java asset.

Responsabilidades

• Design, build, test, and optimize data pipelines and lakehouse on Azure Databricks.
• Lead end-to-end solution design; produce docs and production-grade code.
• Mentor data engineers; oversee hiring, code reviews, and engineering excellence.
• Provide estimates, risks, and dependencies; report blockers to leadership.
• Collaborate with Data Scientists, PO, Architecture, Platform, and Software Eng.

Conocimientos

Python

PySpark

SQL

Data governance

Cloud data engineering

Educación

Bachelor’s degree in Computer Science or related field

Master’s degree asset

Herramientas

Azure Databricks

Azure

Terraform

GitHub Actions

Azure DevOps

Databricks Asset Bundles

Descripción del empleo

Scotiatech is seeking a Senior Data Engineer Lead to design, build, and optimize data pipelines on Azure Databricks for its International Banking initiatives. You will lead a team, deliver production-grade code, and ensure data governance and security across cloud environments.

The role requires strong Python, PySpark, and SQL skills, plus experience in leading complex data projects and collaborating with cross-functional teams. Fluency in English is required; Spanish is a plus.