Azure Data Engineer - ETL & Synapse Architect

Bluelightconsulting; Huancayo; A distancia; PEN 90.000 - 130.000; Jornada completa

Descripción de la vacante

Bluelightconsulting in Peru is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) and Azure Synapse Analytics. You will work with data scientists and analysts to ensure accurate, accessible analytical data in a fast-paced environment.

You will build data pipelines, optimize performance, implement data quality checks, and document data flows while following governance standards.

Formación

• Bachelor's degree in Computer Science or IT, or equivalent experience with relevant certifications a plus.
• Proven ETL experience using Python (PySpark) to extract/transform/load from REST APIs, SQL databases and CSV files.
• Strong SQL skills; experience with SparkSQL and MS SQL for data extraction and transformation.
• Experience with Azure Synapse Analytics Notebooks/Pipelines and related resources.
• Knowledge of data integration best practices, governance, and data quality.

Responsabilidades

• Develop and maintain ETL data engineering processes using Python (PySpark) within Azure Synapse Analytics Notebooks and Pipelines.
• Design and build data warehouses with star schemas in an MPP SQL Pool.
• Extract data from REST APIs, SQL tables, and CSV files; ensure data accuracy and availability.
• Optimize notebooks/pipelines for performance, scalability, and SLAs.
• Monitor ETL jobs, troubleshoot issues, and implement improvements.
• Document data flows, transformations, and governance controls.
• Collaborate with data scientists and analysts to meet reporting needs.
• Ensure data security and compliance with governance standards.

Conocimientos

Python PySpark

Data modeling

Azure Synapse

SQL

Git Azure DevOps

Power BI

Tableau

Educación

Bachelor's degree in Computer Science or IT

Herramientas

Azure Synapse Analytics

PySpark

Linked Services

Azure Key Vault

Git (Azure DevOps)

Power BI

Tableau

Descripción del empleo

Bluelightconsulting in Peru is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) and Azure Synapse Analytics. You will work with data scientists and analysts to ensure accurate, accessible analytical data in a fast-paced environment.

You will build data pipelines, optimize performance, implement data quality checks, and document data flows while following governance standards.