Azure Data Engineer - ETL & Synapse Specialist

Bluelightconsulting; Perímetro Urbano Barranquilla; A distancia; COP 66.960.000 - 133.920.000; Jornada completa

Descripción de la vacante

Bluelight seeks an ETL Data Engineer to design, implement, and maintain data pipelines using Python (PySpark) within Azure Synapse, ensuring accurate and timely data for analytics. You will work closely with data scientists, analysts, and stakeholders to deliver high-quality data solutions.

The role emphasizes scalable data warehousing, data quality, and performance tuning in a fast-paced environment. Strong SQL and governance practices are required, with emphasis on collaboration across teams.

Formación

• Bachelor’s degree in CS, IT, or related field; or equivalent experience, Azure Data Engineer cert a plus.
• Proven ETL data engineering experience with Python (PySpark) for data extraction, transformation and loading from REST APIs, SQL tables, and CSVs.
• Proficiency with Azure Synapse Analytics resources including Notebooks and Pipelines.
• Strong SQL skills (SparkSQL and MS SQL) for data extraction and transformation.
• Knowledge of data integration best practices and version control (Git/Azure DevOps).
• Excellent communication and collaborative skills in a fast-paced team.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse.
• Design data models and warehouse schemas for scalable analytics.
• Extract data from sources: REST APIs, SQL tables, CSV files.
• Tune performance of ETL notebooks/pipelines to meet SLAs.
• Monitor data jobs and troubleshoot pipeline issues.
• Maintain documentation on data flows and transformations.
• Collaborate with data scientists, analysts, and stakeholders for data needs.
• Ensure data security and governance compliance.

Conocimientos

ETL development

Python (PySpark)

Analytical thinking

Team collaboration

Problem solving

Educación

Bachelor’s degree in CS/IT or related

Herramientas

Azure Synapse Analytics

Notebooks

Pipelines

Linked Services

Azure Key Vault

SparkSQL

MS SQL

Git (Azure DevOps)

Power BI

Tableau

Descripción del empleo

Bluelight seeks an ETL Data Engineer to design, implement, and maintain data pipelines using Python (PySpark) within Azure Synapse, ensuring accurate and timely data for analytics. You will work closely with data scientists, analysts, and stakeholders to deliver high-quality data solutions.

The role emphasizes scalable data warehousing, data quality, and performance tuning in a fast-paced environment. Strong SQL and governance practices are required, with emphasis on collaboration across teams.