Azure Synapse ETL Data Engineer | PySpark

Bluelightconsulting; Palmira; A distancia; COP 120.000.000 - 180.000.000; Jornada completa

Descripción de la vacante

Bluelightconsulting is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics to ensure accurate and available analytical data. Collaborate with data scientists, analysts, and stakeholders in a fast-paced environment where quality and collaboration are valued.

The role emphasizes building scalable data pipelines, applying data governance, and leveraging Power BI/Tableau for insights while ensuring performance

Formación

• ETL data engineering with Python (PySpark) for REST APIs, SQL, and CSV sources.
• Experience with Azure Synapse resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
• Strong SQL skills with SparkSQL and MS SQL for data extraction, transformation and loading.
• Familiarity with data integration best practices and Git-based workflows.
• Excellent communication and teamwork in fast-paced environments.
• Experience with Power BI or Tableau is a plus.

Responsabilidades

• Develop and maintain ETL data pipelines using PySpark in Azure Synapse.
• Design data warehouse schemas and star schemas for analytics.
• Extract data from REST APIs, SQL tables, and CSV files.
• Optimize notebooks/pipelines for performance and SLAs.
• Monitor ETL jobs and troubleshoot data issues.
• Document data flows and transformations.
• Collaborate with data scientists, analysts, and engineers.
• Ensure data security and governance compliance.

Conocimientos

PySpark

Python

Azure Synapse Analytics

SQL

REST APIs

CSV data sources

Git / Azure DevOps

Power BI

SparkSQL

Data Modeling

Educación

Bachelor’s degree in CS/IT

Azure Data Engineer certification (plus)

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Linked Services

Azure Key Vault

Git (Azure DevOps)

Descripción del empleo

Bluelightconsulting is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics to ensure accurate and available analytical data. Collaborate with data scientists, analysts, and stakeholders in a fast-paced environment where quality and collaboration are valued.

The role emphasizes building scalable data pipelines, applying data governance, and leveraging Power BI/Tableau for insights while ensuring performance