Azure Data Engineer - PySpark & Synapse

Bluelightconsulting; Puebla de Zaragoza; A distancia; MXN 480.000 - 720.000; Jornada completa

Descripción de la vacante

Bluelight is seeking an experienced ETL Data Engineer to join our expanding data engineering team in Puebla. You will design, develop, and maintain data integration processes using Python (PySpark) and Azure Synapse Analytics to ensure accurate, available analytics data for stakeholders.

You will work with data scientists and analysts, implement data quality checks, optimize pipelines for performance, and contribute to data modeling, security, and governance.

Formación

• Bachelor’s degree in Computer Science / Information Technology or related; or equivalent work experience, Azure Data Engineer certs a plus.
• Proven ETL data engineering experience using Python (PySpark) to extract/transform/load from REST APIs, SQL databases, and CSV files.
• Proficiency with Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Key Vault.
• Strong SQL skills (SparkSQL and MS SQL) for data extraction, transformation, and loading.
• Knowledge of data integration best practices and tools.
• Experience with version control systems (Git/Azure DevOps).
• Strong problem-solving and communication skills; teamwork in agile environments.
• Familiarity with big data, ML, data analysis; Power BI/Tableau is a plus.

Responsabilidades

• Develop and maintain ETL pipelines using Python (PySpark) within Azure Synapse Analytics.
• Design and optimize data warehouses with star schemas and MPP architectures.
• Ingest data from REST APIs, SQL databases, and CSV files.
• Build scalable notebooks and pipelines in Azure Synapse.
• Explore Data Fabric concepts like data lakes, lakehouses, and delta lakes.
• Collaborate with data architects to model data schemas.
• Implement data quality checks and validation processes.
• Monitor ETL jobs and troubleshoot data pipeline issues.
• Maintain documentation of data flows and transformations.
• Support data-related initiatives with cross-functional teams.
• Ensure data security and privacy governance compliance.

Conocimientos

ETL data engineering

Python (PySpark)

SQL queries (SparkSQL & MS SQL)

Azure Synapse Analytics

Data integration best practices

Git (Azure DevOps)

Big data technologies

Data visualization: Power BI, Tableau

Communication skills

Agile methodologies

Educación

Bachelor’s degree in Computer Science / Information Technology or related

Herramientas

Azure Synapse Analytics Notebooks

Azure Synapse Analytics Pipelines

Linked Services

Azure Key Vault

Git (Azure DevOps)

Descripción del empleo

Bluelight is seeking an experienced ETL Data Engineer to join our expanding data engineering team in Puebla. You will design, develop, and maintain data integration processes using Python (PySpark) and Azure Synapse Analytics to ensure accurate, available analytics data for stakeholders.

You will work with data scientists and analysts, implement data quality checks, optimize pipelines for performance, and contribute to data modeling, security, and governance.