Azure Data Engineer: ETL, Pipelines & Warehousing

Bluelightconsulting; Iquitos; A distancia; PEN 204.151 - 408.302; Jornada completa

Descripción de la vacante

Bluelight is seeking a skilled ETL Data Engineer to join our expanding team in the Americas. You will develop and maintain data pipelines using Python (PySpark) in Azure Synapse notebooks and pipelines, building scalable data products that support analytics and decision making.

Collaborating with data architects and cross-functional teams, you will design star schemas, ensure data quality, and optimize performance while upholding governance and security standards.

Formación

• Bachelor’s degree in Computer Science, IT or related field; or equivalent work experience.
• Proven ETL data engineering experience using Python (PySpark) to extract, transform, and load from REST APIs, SQL tables, and CSV files.
• Proficiency with Azure Synapse resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
• Strong SQL skills (SparkSQL/MS SQL) for data extraction, transformation, and loading.
• Knowledge of data integration best practices and tools; Git (Azure DevOps) experience a plus.
• Excellent problem-solving, analytical, and communication skills; team-oriented with attention to detail.
• Familiarity with big data technologies, data governance, and data visualization (Power BI, Tableau).
• Experience with Agile methodologies is a plus.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse Notebooks/Pipelines.
• Design and build data storage structures with star schemas in an MPP SQL pool.
• Extract data from REST APIs, SQL tables, and CSV files.
• Design/optimize notebooks and pipelines for scalability and performance.
• Collaborate with data architects to model data aligned with business needs.
• Implement data quality checks and validation processes.
• Monitor ETL jobs, diagnose issues, and ensure pipeline reliability.
• Maintain documentation of ETL processes and data flows.
• Ensure data security and governance compliance.

Conocimientos

PySpark

Python

SQL

Azure Synapse

SparkSQL

MS SQL

Git (Azure DevOps)

Power BI

Tableau

REST APIs

Educación

Bachelor’s degree in Computer Science / Information Technology

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Azure Key Vault

Git

Delta Lake

Descripción del empleo

Bluelight is seeking a skilled ETL Data Engineer to join our expanding team in the Americas. You will develop and maintain data pipelines using Python (PySpark) in Azure Synapse notebooks and pipelines, building scalable data products that support analytics and decision making.

Collaborating with data architects and cross-functional teams, you will design star schemas, ensure data quality, and optimize performance while upholding governance and security standards.