Azure Data Engineer (PySpark) – ETL & Synapse Expert

Bluelightconsulting; Sur; A distancia; COP 90.000.000 - 150.000.000; Jornada completa

Descripción de la vacante

Bluelight is seeking an ETL Data Engineer to design, build, and maintain data pipelines using Python (PySpark) within Azure Synapse Analytics. You will collaborate with data scientists and analysts to ensure reliable, high‑quality data for insights and decision making.

You should have strong SQL, experience with data warehousing concepts, REST APIs, and data governance. The role requires a collaborative, fast-paced mindset and a passion for scalable data solutions.

Formación

• Bachelor’s degree or equivalent in CS/IT or related field.
• Proven experience with ETL data engineering using Python (PySpark).
• Experience with Azure Synapse Analytics resources and data notebooks/pipelines.
• Strong SQL skills (SparkSQL and MS SQL) for data extraction and transformation.
• Familiarity with REST APIs, CSV/SQL data sources, and data quality checks.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse.
• Design data models and dimensional schemas for scalable data warehousing.
• Extract data from REST APIs, SQL databases, and CSV files.
• Tune pipelines for performance and SLA adherence.
• Monitor jobs and troubleshoot data quality issues and failures.
• Document data flows, transformations, and governance practices.

Conocimientos

Python (PySpark)

Azure Synapse Analytics

ETL/Data Engineering

SQL (SparkSQL/MS SQL)

REST API data extraction

Educación

Bachelor’s degree in CS/IT

Herramientas

Git (Azure DevOps)

Descripción del empleo

Bluelight is seeking an ETL Data Engineer to design, build, and maintain data pipelines using Python (PySpark) within Azure Synapse Analytics. You will collaborate with data scientists and analysts to ensure reliable, high‑quality data for insights and decision making.

You should have strong SQL, experience with data warehousing concepts, REST APIs, and data governance. The role requires a collaborative, fast-paced mindset and a passion for scalable data solutions.