Azure Data Engineer - ETL, PySpark & Synapse

Bluelightconsulting; Nezahualcóyotl; A distancia; MXN 420.000 - 660.000; Jornada completa

Descripción de la vacante

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) within Azure Synapse Analytics to ensure accurate and available analytical data. You will collaborate with data scientists and analysts to deliver high‑quality data for insights and decision‑making.

The role focuses on building scalable ETL pipelines, optimizing performance, and ensuring data quality while aligning with governance standards.

Formación

• Bachelor’s degree in Computer Science, Information Technology, or related field; or equivalent work experience with relevant certifications.
• Proven experience in ETL data engineering using Python (PySpark) for extraction, transformation, and loading from REST APIs, SQL databases, and CSV files.
• Proficiency with Azure Synapse resources including Notebooks, Pipelines, Linked Services, and Key Vault.
• Strong SQL skills (SparkSQL and MS SQL) and ability to optimize queries.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) within Azure Synapse Analytics notebooks and pipelines.
• Design and implement data warehousing solutions with star schemas, facts, and dimensions in an MPP SWL pool.
• Extract data from REST APIs, SQL tables, and CSV files.
• Optimize data notebooks/pipelines for scalability and performance.
• Collaborate with data architects on data models and schemas.
• Implement data quality checks and monitoring to ensure reliability and accuracy.
• Document ETL processes, data flows, and transformations; support data-related initiatives.

Conocimientos

PySpark

Azure Synapse Analytics

SQL

ETL development

REST APIs

Git (Azure DevOps)

Power BI/Tableau

Educación

Bachelor’s degree in CS/IT or related field

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Linked Services

Azure Key Vault

Git

Power BI

Tableau

Descripción del empleo

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) within Azure Synapse Analytics to ensure accurate and available analytical data. You will collaborate with data scientists and analysts to deliver high‑quality data for insights and decision‑making.

The role focuses on building scalable ETL pipelines, optimizing performance, and ensuring data quality while aligning with governance standards.