Azure Data Engineer: ETL, PySpark & Synapse

Bluelightconsulting; Bogotá; A distancia; COP 60.000.000 - 90.000.000; Jornada completa

Descripción de la vacante

Bluelightconsulting seeks a skilled data engineer to design and optimize ETL pipelines using Python (PySpark) within Azure Synapse. You will extract data from REST APIs, SQL databases, and CSVs, build scalable data warehouses, and ensure data quality across workflows.

Collaboration with data architects and adherence to governance are essential. The role emphasizes performance tuning, documentation, and cross-functional teamwork to deliver reliable data solutions for our clients in Latin America

Formación

• Bachelor's degree in computer science, information technology, or related field; equivalent work experience accepted.
• Proven ETL data engineering with Python (PySpark) to extract, transform, load REST APIs, SQL databases, and CSV files.
• Strong SQL skills; SparkSQL and MS SQL experience for data extraction and loading.
• Experience with Azure Synapse analytics resources, notebooks, pipelines, and key vault.
• Knowledge of data integration best practices and data governance principles.

Responsabilidades

• Develop and maintain ETL pipelines using Python (PySpark) in Azure Synapse environments.
• Design data warehousing structures with star schemas, facts, and dimensions for scalable storage.
• Extract data from REST APIs, SQL tables, and CSV files; ensure data quality and accuracy.
• Optimize notebooks/pipelines for performance and scale; monitor and troubleshoot workloads.
• Collaborate with data architects to model data aligned with business needs and governance.

Conocimientos

PySpark

Python

SQL

SparkSQL

Azure Synapse

REST APIs

Data Visualization

Git (Azure DevOps)

Data Quality

Analytical thinking

Educación

Bachelor's degree in Computer Science or Information Technology

Azure Data Engineer certification (plus)

Herramientas

Azure Synapse Analytics

Azure Notebooks/Pipelines

Azure Key Vault

Power BI/Tableau

Git (Azure DevOps)

Descripción del empleo

Bluelightconsulting seeks a skilled data engineer to design and optimize ETL pipelines using Python (PySpark) within Azure Synapse. You will extract data from REST APIs, SQL databases, and CSVs, build scalable data warehouses, and ensure data quality across workflows.

Collaboration with data architects and adherence to governance are essential. The role emphasizes performance tuning, documentation, and cross-functional teamwork to deliver reliable data solutions for our clients in Latin America