DataOps Engineer: Modernize Pipelines & Cloud Migration

ScotiaTech; Colombia; Presencial; COP 139.760.000 - 232.934.000; Jornada completa

Descripción de la vacante

Scotiatech is seeking a DataOps Engineer Specialist to join our team and modernize bank technology through robust data pipelines. You will integrate data across sources, validate end-to-end flows, and support DataOps practices to keep pipelines reliable and scalable.

You will work with SMEs to map data to Delta Lake and document lineage, while contributing to Unity Catalog cataloguing and creating basic Power BI reports to show migration progress across countries and sources.

Formación

• Bachelor’s degree in Computer Science or related field.
• Master’s degree is a plus.
• Certifications in Databricks, GCP, Azure or AWS are a plus.
• 3+ years of experience in DataOps, data integration, or data engineering support.
• Experience with data migration or cloud modernization (on-prem or GCP to Azure Databricks is a plus).
• Familiarity with CI/CD, Git, automated testing, and monitoring.

Responsabilidades

• Integrate data across sources, including legacy on‑premises to Azure Databricks, validating end‑to‑end data flow.
• Deploy and reuse ingestion, transformation, and integration patterns with architecture teams.
• Support DataOps practices (Git, CI/CD, automated testing, monitoring) for reliable pipelines.
• Explore legacy and GCP data, map source to Delta Lake, document lineage and dependencies.
• Check data quality and reconcile source vs. target across Bronze–Silver–Gold layers.
• Collaborate with SMEs to articulate data meanings and aid Unity Catalog cataloguing.
• Build simple reports/dashboards (Power BI) on data availability and migration progress by country/source/owner.

Conocimientos

DataOps

Data integration

PySpark

Python

SQL

Delta Lake

Unity Catalog

Azure Databricks

Educación

Bachelor's degree

Master's degree

Herramientas

Databricks

GCP

Azure

AWS

Terraform

Power BI

Delta Lake

Descripción del empleo

Scotiatech is seeking a DataOps Engineer Specialist to join our team and modernize bank technology through robust data pipelines. You will integrate data across sources, validate end-to-end flows, and support DataOps practices to keep pipelines reliable and scalable.

You will work with SMEs to map data to Delta Lake and document lineage, while contributing to Unity Catalog cataloguing and creating basic Power BI reports to show migration progress across countries and sources.