Azure Data Engineer: ETL & Analytics in Synapse

Bluelightconsulting; Concepcion; A distancia; CLP 18.000.000 - 30.000.000; Jornada completa

Descripción de la vacante

Bluelight is a leading software consultancy seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics. You will ensure data accuracy and availability for analytics, collaborating with data scientists, analysts, and stakeholders in a fast-paced environment.

The role focuses on building scalable ETL processes, implementing data quality checks, and optimizing performance while ensuring data governance and security

Formación

• Bachelor’s degree in CS/IT or equivalent, with related certifications a plus.
• Proven ETL experience using Python (PySpark) for data extraction, transformation, loading.
• Experience with Azure Synapse resources: Notebooks, Pipelines, Linked Services, Key Vault.
• Strong SQL skills; SparkSQL and MS SQL experience.
• Knowledge of data integration best practices and tools.
• Experience with Git or Azure DevOps.

Responsabilidades

• Develop and maintain ETL data pipelines in PySpark within Azure Synapse.
• Design data warehouses using star schemas, facts and dimensions.
• Extract data from REST APIs, SQL databases, and CSV files.
• Tune performance and monitor ETL jobs to meet SLAs.
• Document data flows, transformations, and processes.
• Collaborate with data scientists and analysts and ensure data governance.

Conocimientos

Python PySpark

Azure Synapse

SQL

SparkSQL

MS SQL

Git Azure DevOps

Data Modeling

Data Warehousing

Data Quality

Documentation

Big Data

Power BI Tableau

Educación

BSc in CS/IT

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Azure Key Vault

Linked Services

Azure DevOps

Descripción del empleo

Bluelight is a leading software consultancy seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics. You will ensure data accuracy and availability for analytics, collaborating with data scientists, analysts, and stakeholders in a fast-paced environment.

The role focuses on building scalable ETL processes, implementing data quality checks, and optimizing performance while ensuring data governance and security