Azure Data Engineer: ETL & Synapse Expert

Bluelightconsulting; Colombia; A distancia; COP 90.000.000 - 150.000.000; Jornada completa

Descripción de la vacante

Bluelightconsulting in Colombia seeks a data engineer to design and implement robust ETL pipelines using Python (PySpark) in Azure Synapse Analytics, ensuring scalable data extraction, transformation, and loading from REST APIs, SQL tables, and CSVs.

You will collaborate with data architects, implement data quality checks, optimize queries, and contribute to data governance, lakes and cataloging initiatives while supporting cross-functional teams.

Formación

• Bachelor's degree in Computer Science, Information Technology, or related field; or equivalent work experience, with Azure Data Engineer certs a plus.
• Proven experience in ETL data engineering with Python (PySpark) for data extraction, transformation and loading from REST APIs, SQL tables, and CSV files.
• Proficiency with Azure Synapse resources including Notebooks, Pipelines, Linked Services, and Key Vault.

Responsabilidades

• Develop and maintain ETL data engineering processes using Python (PySpark) within Azure Synapse Notebooks and/or Pipelines for efficient data extraction, transformation, and loading.
• Design and build data storage structures in an MPP SQL pool using star schemas, facts, and dimensions.
• Extract data from REST APIs, SQL tables, and CSV files; ensure data quality and reliability.
• Collaborate with data architects to create data models and schemas aligned with business requirements; monitor and optimize performance.
• Maintain comprehensive documentation of ETL processes, data flows, and transformations; support data governance and security.

Conocimientos

PySpark

ETL

SQL

Azure Synapse

Data quality

Git

Power BI

Educación

Bachelor's degree in CS or related field

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Azure DevOps

Descripción del empleo

Bluelightconsulting in Colombia seeks a data engineer to design and implement robust ETL pipelines using Python (PySpark) in Azure Synapse Analytics, ensuring scalable data extraction, transformation, and loading from REST APIs, SQL tables, and CSVs.

You will collaborate with data architects, implement data quality checks, optimize queries, and contribute to data governance, lakes and cataloging initiatives while supporting cross-functional teams.