Azure Data Engineer: ETL & Synapse Pipelines

Bluelightconsulting; Cuzco; A distancia; PEN 60.000 - 120.000; Jornada completa

Descripción de la vacante

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data pipelines using Python (PySpark) within Azure Synapse Analytics. You will work closely with data scientists and analysts to ensure accurate and accessible analytical data, focusing on scalable ETL processes and robust data quality checks.

The role emphasizes collaboration across teams, documentation, and adherence to data governance standards in a dynamic environment.

Formación

• Bachelor’s degree or equivalent experience, with data engineering certifications a plus.
• Strong PySpark ETL experience from REST APIs, SQL tables, and CSVs.

Responsabilidades

• Develop and maintain ETL data pipelines using PySpark in Azure Synapse.
• Design and optimize data warehouses with star schemas, facts, and dimensions.
• Extract data from REST APIs, SQL tables, and CSV files.
• Optimize notebooks/pipelines for performance and scalability.
• Ensure data quality, monitoring, and documentation of processes.

Conocimientos

PySpark

Azure Synapse

SQL

ETL

REST APIs

Data Warehousing

Data Modeling

Data Quality

Monitoring

Git / Azure DevOps

Power BI / Tableau

Agile

Educación

Bachelor’s degree in CS/IT or related field

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Azure Key Vault

Git (Azure DevOps)

Descripción del empleo

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data pipelines using Python (PySpark) within Azure Synapse Analytics. You will work closely with data scientists and analysts to ensure accurate and accessible analytical data, focusing on scalable ETL processes and robust data quality checks.

The role emphasizes collaboration across teams, documentation, and adherence to data governance standards in a dynamic environment.