DataOps Engineer: Azure Databricks & Data Integration

Scotiabank; Bogotá; Híbrido; COP 70.000.000 - 120.000.000; Jornada completa

Descripción de la vacante

Scotiabank seeks a DataOps Engineer to enable data integration and DataOps for International Banking, driving reliable data flow into Azure Databricks. You will partner with SMEs and senior engineers to map legacy data for migration with confidence.

You will work across Data Integration, Pattern Deployment, DataOps automation, and governance, delivering clear source-to-target mappings and dashboards to show migration progress by country and owner.

Formación

• 3+ years of DataOps, data integration, or data engineering experience.
• Experience mapping data and supporting data migration to cloud.
• Strong SQL and large-scale data warehousing knowledge.
• Familiarity with Agile environments.
• Experience with cross-functional collaboration.

Responsabilidades

• Data Integration across sources and validation of end-to-end data flow.
• Deploy ingestion/transformation patterns with architecture guidance.
• Support DataOps practices (Git, CI/CD, automated testing, monitoring).
• Discover and map legacy and GCP data for Delta Lake migration.
• Ensure data quality and parity across Bronze-Silver-Gold.
• Collaborate with SMEs to articulate data meaning and catalog via Unity Catalog.
• Build dashboards showing data availability and migration progress by country and owner.

Conocimientos

Azure Databricks

PySpark

Python

SQL

Data modeling

Delta Lake

Unity Catalog

Git CI/CD

Cloud data migration

Educación

Bachelor's degree in Computer Science

Master's degree

Herramientas

Databricks

Azure

GCP

AWS

Descripción del empleo

Scotiabank seeks a DataOps Engineer to enable data integration and DataOps for International Banking, driving reliable data flow into Azure Databricks. You will partner with SMEs and senior engineers to map legacy data for migration with confidence.

You will work across Data Integration, Pattern Deployment, DataOps automation, and governance, delivering clear source-to-target mappings and dashboards to show migration progress by country and owner.