Azure Data Engineer: ETL, PySpark & Synapse

Bluelightconsulting; Chihuahua; A distancia; MXN 600.000 - 900.000; Jornada completa

Descripción de la vacante

Bluelightconsulting is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) within Azure Synapse Analytics. The role focuses on ensuring accurate, reliable analytical data for stakeholders and works closely with data scientists, analysts, and cross-functional teams in a dynamic environment.

You will implement ETL pipelines, design scalable data stores, and apply best practices in data governance and security while collaborating with the

Formación

• Bachelor’s degree in Computer Science, IT, or related field; certifications related to data engineering or data science (e.g., Azure Data Engineer) a plus.
• Proven ETL data engineering experience using Python (PySpark) for data extraction, transformation, and loading from REST APIs, SQL databases, and CSV files.
• Proficiency with Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
• Strong SQL skills; experience with SparkSQL and MS SQL for data extraction and loading.
• Knowledge of data integration best practices and tools; version control with Git (Azure DevOps).
• Excellent problem-solving, analytical skills, and clear communication in a team with shifting priorities.
• Familiarity with big data technologies, ML/data analysis, and BI tools like Power BI/Tableau.

Responsabilidades

• ETL data engineering: build and maintain Python (PySpark) ETL within Azure Synapse Notebooks or Pipelines.
• Data warehousing: design star schemas, facts and dimensions in an MPP SWL pool.
• Extract data from REST APIs, SQL tables, and CSV files.
• Leverage Azure Synapse Analytics to optimize notebooks and pipelines for performance.
• Contribute to data fabric concepts like data lakes and cataloging.
• Collaborate with data architects on data models and schemas.
• Implement data quality checks and validate data accuracy and consistency.
• Monitor ETL jobs, troubleshoot issues, and ensure pipeline reliability.
• Document ETL processes and data flows; collaborate across teams.
• Ensure data security and governance compliance.

Conocimientos

Python (PySpark)

Azure Synapse

SQL

Data modeling

Data quality

Data warehousing

Power BI

Tableau

Git

Analytical thinking

Educación

Bachelor’s degree in Computer Science / IT

Azure Data Engineer certification

Equivalent work experience

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Azure Key Vault

Git (Azure DevOps)

MS SQL

SparkSQL

Descripción del empleo

Bluelightconsulting is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) within Azure Synapse Analytics. The role focuses on ensuring accurate, reliable analytical data for stakeholders and works closely with data scientists, analysts, and cross-functional teams in a dynamic environment.

You will implement ETL pipelines, design scalable data stores, and apply best practices in data governance and security while collaborating with the