Azure ETL Data Engineer: Synapse & PySpark

Bluelightconsulting; La Plata; A distancia; ARS 88.483.829 - 132.725.744; Jornada completa

Descripción de la vacante

Bluelightconsulting is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) within Azure Synapse Analytics. You will work closely with data scientists, analysts and other stakeholders to ensure the accuracy and availability of analytical data.

The ideal candidate has hands-on experience with ETL pipelines, SQL, and data warehousing concepts, and thrives in a fast-paced environment where collaboration and data quality are prioritized.

Formación

• Bachelor's degree in CS/IT or equivalent with data engineering focus.
• Experience building ETL pipelines using Python (PySpark) to extract, transform and load from REST APIs, SQL databases and CSV files.
• Proficiency with Azure Synapse Analytics Notebooks & Pipelines, and data warehousing concepts.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse to ensure accurate data delivery.
• Design data models and star-schemas for data warehousing in an MPP SQL pool.
• Collaborate with data scientists and analysts to meet data needs and SLAs.
• Monitor data pipelines, optimize performance, and troubleshoot issues.
• Maintain documentation of data flows, transformations, and governance.

Conocimientos

Python

PySpark

Azure Synapse Analytics

SQL

Git

Power BI

Tableau

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Azure Synapse

Python

SQL

Spark SQL

Descripción del empleo

Bluelightconsulting is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) within Azure Synapse Analytics. You will work closely with data scientists, analysts and other stakeholders to ensure the accuracy and availability of analytical data.

The ideal candidate has hands-on experience with ETL pipelines, SQL, and data warehousing concepts, and thrives in a fast-paced environment where collaboration and data quality are prioritized.