DataOps Engineer for Azure Databricks & Lakehouse Enablement

Scotiabank; Bogotá; Presencial; COP 90.000.000 - 140.000.000; Jornada completa

Descripción de la vacante

Scotiabank in Bogota seeks a DataOps Engineer Specialist to enable data integration and DataOps across International Banking. You will work hands-on with architecture and senior engineers to migrate legacy on-prem and GCP data to Azure Databricks, ensuring trusted, well‑understood data for migration in multiple markets.

The role requires 3+ years in DataOps or data engineering, strong PySpark/Python, SQL expertise, and experience with Git, CI/CD, and Agile teams.

Formación

• Bachelor’s degree in Computer Science, Data Engineering, IT or related field.
• 3+ years of DataOps, data integration, or data engineering experience.
• Experience mapping data and supporting data migration or cloud modernization.
• Strong SQL skills and large-scale data warehouse experience.
• Familiarity with DataOps practices (Git, CI/CD, testing, monitoring).
• Ability to work with SMEs and cross-functional teams in Agile delivery.

Responsabilidades

• Integrate data across sources including on‑prem to Azure Databricks and validate end‑to‑end flows.
• Deploy approved ingestion, transformation and integration patterns with architecture team.
• Support DataOps: Git, CI/CD, automated tests, monitoring to keep pipelines reliable.
• Discover and map legacy and GCP data to Delta Lake model with lineage documentation.
• Ensure data quality and parity across Bronze→Silver→Gold medallion layers.
• Collaborate with SMEs and catalog data in Unity Catalog for discoverability.
• Build simple reports/dashboards (Power BI) showing data availability and migration progress.

Conocimientos

Data integration

Apache Spark (PySpark)

Python

SQL

DataOps practices

Git

CI/CD

Agile

Cross-functional collaboration

Educación

Bachelor's degree in Computer Science / Data Engineering / IT / Software Engineering

Master's degree is a plus

Herramientas

Azure Databricks

Delta Lake

Unity Catalog

Power BI

GCP / AWS

Descripción del empleo

Scotiabank in Bogota seeks a DataOps Engineer Specialist to enable data integration and DataOps across International Banking. You will work hands-on with architecture and senior engineers to migrate legacy on-prem and GCP data to Azure Databricks, ensuring trusted, well‑understood data for migration in multiple markets.

The role requires 3+ years in DataOps or data engineering, strong PySpark/Python, SQL expertise, and experience with Git, CI/CD, and Agile teams.