Data engineer

ScotiaTech; Colombia; Presencial; COP 100.440.000 - 156.240.000; Jornada completa

Descripción de la vacante

ScotiaTech, a unit of Scotia GBS/GSG Colombia, seeks a Data Engineer to design and optimize data pipelines on Azure Databricks and Delta Lake, enabling scalable data products for international banking.

You will lead end-to-end solution design, produce technical docs, and deliver production-grade code while mentoring a team of data engineers and collaborating with cross-functional partners.

Formación

• 2+ years of progressive hands-on experience in data engineering, including at least 3 years delivering production data solutions on Microsoft Azure and/or Azure Databricks.
• Proven experience as a technical lead on complex data initiatives with design reviews and team coaching.
• Expertise in designing and implementing data pipelines using Azure Databricks, Spark, Delta Lake, Unity Catalog, Workflows, Azure Data Factory, ADLS Gen2, Event Hubs, and Synapse.

Responsabilidades

• Design, build, test, and optimize data pipelines and lakehouse solutions on Azure and Azure Databricks to support scalable data products.
• Act as hands-on technical lead for end-to-end solution design, documentation, and production-grade code delivery.
• Lead, mentor, and develop a team of Data Engineers, including coaching, performance feedback, and hiring participation.

Conocimientos

Azure Databricks

Delta Lake

Spark

Azure Data Factory

Azure Synapse

Technical leadership

Data modeling

Herramientas

Azure Databricks

Unity Catalog

Azure Data Lake Storage Gen2

Event Hubs

Descripción del empleo

Scotiatech is a world-class engineering group! We are seeking to modernize bank technology by delivering a trustworthy, unique and top-quality service. Our main banners are inclusiveness, diversity and different ideas for our customers and employees to reach their top potential.

If you're looking for your next big challenge, then ScotiaGBS is the place to be!

What will you do as a Data Engineer?

• Design, build, test, and optimize data pipelines and lakehouse solutions on Azure and Azure Databricks (Delta Lake, medallion architecture) to support scalable data products for International Banking.
• Act as the hands-on technical lead for assigned initiatives: own the end-to-end solution design, produce the technical documentation, and deliver production-grade code.
• Lead, mentor, and develop a team of Data Engineers, including work assignment, coaching, performance feedback, and participation in hiring; lead code and design reviews and promote a culture of engineering excellence, collaboration, and continuous improvement.
• Provide effort estimates, technical risks, and dependencies to support delivery planning, allocate work across the team, and keep the Director informed of progress and blockers.
• Collaborate with cross-functional partners (Data Scientists, Product Owners, Architecture, Platform Engineering, and Software Engineering) to translate business requirements into data products aligned with international business goals.

What do we expect from you?

• 2+ years of progressive hands-on experience in data engineering, including at least 3 years delivering production data solutions on Microsoft Azure and/or Azure Databricks.
• Demonstrated experience as a technical lead on complex data initiatives, including leading design and code reviews and directly supervising, coaching, and developing data engineers.
• Expertise in designing and implementing data pipelines using Azure Databricks (Spark, Delta Lake, Unity Catalog, Workflows), Azure Data Factory, Azure Data Lake Storage Gen2, Event Hubs, and Azure Synapse or equivalent serving layers.

What's in it for you?

• Great professional growth opportunities
• A great diverse, dynamic, and multicultural work environment
• Financial and emotional wellness
• Competitive salaries… and a lot more!

ScotiaTech is a unit of Scotia GBS/GSG Colombia