Azure Synapse ETL Engineer - PySpark & Data Warehousing

Bluelightconsulting; Trujillo; A distancia; PEN 60.000 - 100.000; Jornada completa

Descripción de la vacante

Bluelight is a leading software consultancy delivering innovative technology solutions across the Americas. We seek an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) in Azure Synapse, ensuring accurate, timely data for analytics and decision-making.

You will collaborate with data scientists, analysts, and stakeholders to implement scalable data pipelines, data models, and data quality checks while upholding security and governance standards

Formación

• Experience in ETL data engineering with Python (PySpark) to extract/transform/load from REST APIs, SQL databases, and CSV files.
• Proficiency with Azure Synapse Analytics resources (Notebooks, Pipelines, Linked Services, Key Vault).
• Strong SQL skills (SparkSQL and MS SQL) for ETL processes.
• Familiarity with data integration best practices and version control (Git/Azure DevOps).
• Excellent communication and teamwork in fast-paced environments.
• Knowledge of data visualization tools (Power BI, Tableau) and Agile methods.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse.
• Design data warehouses with star schemas and fact/dimension tables.
• Extract data from REST APIs, SQL databases, and CSV files.
• Optimize notebooks/pipelines for scalability and performance.
• Implement data quality checks and monitoring to meet SLAs.
• Create documentation of data flows and transformations.
• Collaborate with data scientists and analysts across teams.
• Ensure data security and governance compliance.
• Troubleshoot ETL jobs and resolve data pipeline issues.
• Support data-related initiatives and cross-functional collaboration.

Conocimientos

Python (PySpark)

SQL queries

Data modeling

Data quality checks

Problem-solving

Communication skills

Educación

Bachelor’s degree in Computer Science or related

Azure Data Engineer certification (nice-to-have)

Herramientas

Azure Synapse Analytics

Notebooks

Pipelines

Linked Services

Azure Key Vault

Git/Azure DevOps

Power BI

Tableau

Descripción del empleo

Bluelight is a leading software consultancy delivering innovative technology solutions across the Americas. We seek an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) in Azure Synapse, ensuring accurate, timely data for analytics and decision-making.

You will collaborate with data scientists, analysts, and stakeholders to implement scalable data pipelines, data models, and data quality checks while upholding security and governance standards