Remote Senior Azure Data Engineer: Lakehouse & ML Pipelines

Capgemini; Bogotá; A distancia; COP 90.000.000 - 180.000.000; Jornada completa

Descripción de la vacante

Capgemini Engineering in Bogotá seeks a Senior Data Engineer to design, build, optimize, and maintain scalable data pipelines in cloud environments. You will develop ETL/ELT processes with Python, PySpark, SQL, Azure Databricks, and Azure Data Factory to support BI, ML, and AI initiatives.

Collaborate with data science teams to prepare and transform data for analytical models, implement data governance and security, monitor production pipelines, and automate deployments via Azure DevOps.

Formación

• Bachelor’s degree required in a technical field such as CS/SE/DS.
• Strong programming experience in Python and Spark for building data pipelines.
• Experience with cloud data platforms (Azure) and data governance.

Responsabilidades

• Design, develop, and maintain scalable data pipelines in cloud environments.
• Collaborate with Data Science teams to prepare, transform data for analytics models.
• Implement data governance, security, and observability standards.

Conocimientos

Python

PySpark

REST APIs

SQL

Git

Educación

Bachelor's degree in Computer Science, Software Engineering, Data Science or related field

Herramientas

Azure Databricks

Azure Data Factory

Azure Functions

Azure Key Vault

Azure Storage Accounts

Azure Logic Apps

Azure DevOps

Descripción del empleo

Capgemini Engineering in Bogotá seeks a Senior Data Engineer to design, build, optimize, and maintain scalable data pipelines in cloud environments. You will develop ETL/ELT processes with Python, PySpark, SQL, Azure Databricks, and Azure Data Factory to support BI, ML, and AI initiatives.

Collaborate with data science teams to prepare and transform data for analytical models, implement data governance and security, monitor production pipelines, and automate deployments via Azure DevOps.