Azure Data Engineer - ETL, PySpark & Synapse Mastery

Bluelightconsulting; León; A distancia; MXN 420.000 - 660.000; Jornada completa

Descripción de la vacante

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics to ensure accurate, accessible analytics for stakeholders.

You will collaborate with data scientists and analysts, implement data quality checks, optimize ETL notebooks and pipelines for performance, and document data flows while upholding data governance and security standards in a dynamic, collaborative environment.

Formación

• Bachelor’s degree or equivalent work experience in computing/IT.
• Experience with Python-based ETL/ELT development using PySpark.
• Proficiency with Azure Synapse resources (Notebooks, Pipelines, Linked Services, Key Vault).

Responsabilidades

• ETL data engineering: build and maintain ETL processes in PySpark within Azure Synapse.
• Data warehousing: design star schemas and scalable data storage in MPP environments.
• Extract data from REST APIs, SQL tables, and CSV files.
• Optimize and tune Azure Synapse notebooks/pipelines for performance.
• Ensure data quality with validation checks and governance practices.
• Collaborate with data scientists and analysts for data needs.
• Document data flows, transformations, and pipelines.
• Monitor data pipelines and troubleshoot issues to meet SLAs.

Conocimientos

PySpark

Azure Synapse Analytics

SQL

ETL

REST APIs

Git (Azure DevOps)

Power BI/Tableau

Educación

Bachelor’s degree in Computer Science / IT

Azure Data Engineer certification (bonus)

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Linked Services

Azure Key Vault

Power BI

Tableau

Git (Azure DevOps)

SparkSQL / MS SQL

Descripción del empleo

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics to ensure accurate, accessible analytics for stakeholders.

You will collaborate with data scientists and analysts, implement data quality checks, optimize ETL notebooks and pipelines for performance, and document data flows while upholding data governance and security standards in a dynamic, collaborative environment.