Azure Data Engineer: ETL, Analytics & Synapse

Bluelightconsulting; Chiclayo; A distancia; PEN 60.000 - 120.000; Jornada completa

Descripción de la vacante

Bluelightconsulting is hiring a Data Engineer to develop and maintain ETL data pipelines using Python (PySpark) within Azure Synapse Notebooks and Pipelines. The role focuses on scalable data extraction, transformation, and loading to support analytics in a leading software consultancy.

You will design star schemas, work with REST APIs and SQL/CSV sources, and collaborate with data architects to ensure data quality and governance across data fabrics in a fast-paced environment.

Formación

• Bachelor's degree in CS/IT or equivalent work experience; Azure Data Engineer cert is a plus.
• Proven ETL data engineering experience using Python (PySpark) for REST APIs, SQL tables and CSVs.
• Strong knowledge of Azure Synapse resources: Notebooks, Pipelines, Linked Services, Key Vault.

Responsabilidades

• Develop and maintain ETL data pipelines using PySpark in Azure Synapse Notebooks and/or Pipelines.
• Design star schemas and data models for Massively Parallel Processing (MPP) workloads.
• Extract data from REST APIs, SQL tables, and CSV files.
• Optimize notebooks/pipelines for scalability and performance in Azure Synapse.
• Implement data lakes, delta lakes, and data cataloging as part of data fabric.
• Collaborate with data architects to align data models with business needs.
• Add data quality checks and validations to ensure accuracy.
• Identify performance bottlenecks and tune ETL jobs to meet SLAs.
• Monitor ETL jobs and troubleshoot data pipelines; maintain documentation.
• Work with cross-functional teams to support data initiatives and governance.

Conocimientos

Python (PySpark)

Azure Synapse Analytics

SQL (SparkSQL/MS SQL)

ETL data engineering

REST APIs

Git (Azure DevOps)

Data modeling

Educación

Bachelor’s degree in Computer Science or Information Technology

Herramientas

Azure Synapse Analytics Notebooks

Azure Synapse Pipelines

Linked Services

Azure Key Vault

SparkSQL

MS SQL

Power BI

Descripción del empleo

Bluelightconsulting is hiring a Data Engineer to develop and maintain ETL data pipelines using Python (PySpark) within Azure Synapse Notebooks and Pipelines. The role focuses on scalable data extraction, transformation, and loading to support analytics in a leading software consultancy.

You will design star schemas, work with REST APIs and SQL/CSV sources, and collaborate with data architects to ensure data quality and governance across data fabrics in a fast-paced environment.