Azure Databricks Data Engineer — Pipelines & Governance

ScotiaTech; Colombia; Presencial; COP 90.000.000 - 140.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Diverse environment

Benefits for well-being

Competitive wages

Descripción de la vacante

Scotiatech in Colombia is seeking a Data Engineer Specialist to design, build, and maintain scalable data pipelines on Azure Databricks, enabling reliable data flow for analytics and reporting.

You will collaborate with data scientists, product owners, and platform teams to implement data models, ensure data quality, security, and governance, and drive DevOps/DataOps practices across cloud environments.

Formación

• 3-5 years of experience in Data Engineering
• Hands-on experience with Azure Databricks and Spark
• Strong SQL and data warehousing knowledge
• Experience with data governance and security practices

Responsabilidades

• Build, test, and maintain data pipelines on Azure Databricks.
• Collaborate with data scientists and product teams to deliver data solutions.
• Implement models, schemas, and transformations for analytics.
• Monitor pipelines for quality, performance, and cost efficiency.
• Enforce data governance and security in Azure environments (Unity Catalog, RBAC).
• Troubleshoot issues and perform root-cause analyses.
• Advise on DevOps/DataOps practices and automation.

Conocimientos

Data pipelines

Azure Databricks

PySpark

Python

SQL

Agile

DevOps

Herramientas

Delta Lake

Unity Catalog

Git

CI/CD

Descripción del empleo

Scotiatech in Colombia is seeking a Data Engineer Specialist to design, build, and maintain scalable data pipelines on Azure Databricks, enabling reliable data flow for analytics and reporting.

You will collaborate with data scientists, product owners, and platform teams to implement data models, ensure data quality, security, and governance, and drive DevOps/DataOps practices across cloud environments.