Senior Data Engineer - Multi-Cloud Data Pipelines Lead

Scotiabank; Puerto Bogotá; On-site; COP 120,000,000 - 180,000,000; Full time

Job summary

Scotiabank is seeking a Senior Data Engineer to lead the design, development, and maintenance of scalable data products and pipelines across AWS, Azure, and GCP. You will mentor a small team, collaborate with data scientists, product managers, and software engineers, and ensure secure, compliant data infrastructure.

The ideal candidate has 6+ years in data engineering, hands-on cloud experience, and strong Python/Java/Scala skills, plus data warehousing expertise.

Qualifications

• 6+ years of data engineering experience, incl. 3+ years on cloud data solutions
• Hands-on with Azure, AWS, and GCP
• 2+ years leading or mentoring a team of engineers
• Proficient in Python/Java/Scala and SQL for data processing
• Strong data modeling, schema design, and data warehousing
• Familiar with CI/CD, version control (Git), and IaC (Terraform)
• Excellent communication with non-technical stakeholders

Responsibilities

• Design, build, and optimize data pipelines and architectures on cloud platforms to support data products, ensuring scalability, reliability, and performance
• Lead a team of up to three Data Engineers, providing mentorship, technical direction, and performance feedback
• Collaborate with cross-functional teams to understand requirements and deliver data products that align with business goals
• Implement best practices for data governance, security, and compliance within cloud environments
• Monitor and maintain data infrastructure, ensuring high availability, data quality, and efficient processing
• Drive the adoption of modern data engineering tools and methodologies, including ETL/ELT, data modeling, and orchestration
• Troubleshoot and resolve complex data pipeline issues, ensuring minimal downtime and optimal performance

Skills

Python

Java

Scala

SQL

Education

Bachelor’s degree in Computer Science/Data Engineering/IT

Master’s degree (asset)

Tools

Databricks

BigQuery

Dataflow

Dataproc

Pub/Sub

Cloud Composer

Terraform

Git

Job description

Scotiabank is seeking a Senior Data Engineer to lead the design, development, and maintenance of scalable data products and pipelines across AWS, Azure, and GCP. You will mentor a small team, collaborate with data scientists, product managers, and software engineers, and ensure secure, compliant data infrastructure.

The ideal candidate has 6+ years in data engineering, hands-on cloud experience, and strong Python/Java/Scala skills, plus data warehousing expertise.