Azure Databricks Lakehouse Lead Engineer

GSG-GESTIÓN DE SERVICIOS GLOBALES S.A.S; Bogotá; Presencial; COP 90.000.000 - 170.000.000; Jornada completa

Descripción de la vacante

GSG-GESTIÓN DE SERVICIOS GLOBALES S.A.S. seeks a Senior Data Engineer to design, build, and maintain scalable data products and pipelines on Microsoft Azure and Azure Databricks.

You will lead a team, establish best practices, and ensure secure, compliant lakehouse solutions that empower data-driven decisions across markets. You will own end-to-end solution design, mentor engineers, and collaborate with Product Owners and Architects to deliver high-quality data platforms while optimizing cost,

Formación

• 5+ years in Data Engineering with 3+ on Azure/Azure Databricks.
• Proven track record leading technical projects.
• Strong experience with Azure Databricks, Spark, Delta Lake, Unity Catalog, Workflows.
• Hands-on Python, PySpark, SQL; data modeling and lakehouse architectures.
• Experience with CI/CD, Git, Terraform or Bicep; IaC principles.
• Knowledge of cloud security, RBAC, data privacy, and compliance.
• Experience with cloud migration projects is highly valued.
• Excellent English communication (B2+).

Responsabilidades

• Design, build, and optimize data pipelines and lakehouse solutions on Azure Databricks.
• Lead technical design and delivery from concept to production.
• Mentor Data Engineers through coaching and code reviews.
• Collaborate with Product Owners, Data Scientists, Architects, and Eng teams.
• Implement data governance, security, and access management practices.
• Monitor platforms for reliability, performance, data quality, and cost.
• Drive DataOps, DevOps, and CI/CD adoption for cloud-native solutions.
• Troubleshoot complex issues and implement long-term fixes.
• Support cloud migration of legacy/GCP workloads to Azure Databricks.
• Evaluate new technologies to strengthen data capabilities.

Conocimientos

Leadership

Stakeholder management

Communication

Ownership

Problem solving

Mentoring

Educación

Bachelor's degree in Computer Science/IT/Data Science

Herramientas

Azure Databricks

Delta Lake

Unity Catalog

Workflows

Azure Data Factory

Azure Data Lake Storage Gen2

Event Hubs

Azure Synapse

Terraform or Bicep

Git

Descripción del empleo

GSG-GESTIÓN DE SERVICIOS GLOBALES S.A.S. seeks a Senior Data Engineer to design, build, and maintain scalable data products and pipelines on Microsoft Azure and Azure Databricks.

You will lead a team, establish best practices, and ensure secure, compliant lakehouse solutions that empower data-driven decisions across markets. You will own end-to-end solution design, mentor engineers, and collaborate with Product Owners and Architects to deliver high-quality data platforms while optimizing cost,