Azure Data Engineer: ETL, PySpark & Synapse Expert

Bluelightconsulting; Iquitos; A distancia; PEN 204.429 - 306.644; Jornada completa

Descripción de la vacante

Bluelightconsulting is seeking an ETL Data Engineer to join our growing data engineering team. You will design, develop, and maintain data pipelines using Python (PySpark) and Azure Synapse Analytics to ensure accurate, reliable analytical data for stakeholders.

Collaborate with data scientists, analysts, and cross‑functional teams to optimize data models, implement data quality checks, and deliver scalable solutions while adhering to governance and security standards.

Formación

• Bachelor's degree in Computer Science, Information Technology, or related field, or equivalent experience.
• Proven ETL experience with Python (PySpark) to extract/transform/load from REST APIs, SQL databases, and CSV.
• Proficiency with Azure Synapse Analytics resources including Notebooks and Pipelines.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse.
• Design and build data warehouses with star schemas, facts, and dimensions.
• Extract data from REST APIs, SWL databases, and CSV files.
• Optimize notebooks/pipelines for scalability and performance in Azure Synapse.
• Contribute to data fabric concepts, data lakes, lakehouses, and data cataloging.
• Collaborate with data architects on data models and schemas.
• Implement data quality checks and validation processes.
• Identify and resolve ETL performance bottlenecks to meet SLAs.
• Monitor ETL jobs and troubleshoot issues to ensure reliability.
• Maintain documentation of data flows and transformations.
• Work with cross-functional teams to support data initiatives.
• Ensure data security and privacy compliance.

Conocimientos

Python (PySpark)

ETL data engineering

SQL

Data modeling

Data warehousing

Azure Synapse Analytics

SparkSQL

Git / Azure DevOps

Communication

Agile methodologies

Power BI

Educación

Bachelor's degree in CS/IT

Herramientas

Azure Synapse Analytics

Git (Azure DevOps)

Power BI

Tableau

Descripción del empleo

Bluelightconsulting is seeking an ETL Data Engineer to join our growing data engineering team. You will design, develop, and maintain data pipelines using Python (PySpark) and Azure Synapse Analytics to ensure accurate, reliable analytical data for stakeholders.

Collaborate with data scientists, analysts, and cross‑functional teams to optimize data models, implement data quality checks, and deliver scalable solutions while adhering to governance and security standards.