Azure Data Engineer: ETL & Analytics Expert

Bluelightconsulting; Tijuana; A distancia; MXN 520.000 - 780.000; Jornada completa

Descripción de la vacante

Bluelight is seeking a skilled Data Engineer to design, develop and maintain ETL data pipelines using PySpark in Azure Synapse Analytics. You will pull data from REST APIs, SQL tables and CSV files, transform it into reliable, scalable datasets, and ensure efficient execution within the Synapse notebooks or pipelines.

The role requires collaborating with data architects to build star-schema models, implement data quality checks, monitor jobs, and participate in data governance and security

Formación

• Bachelor’s degree or equivalent in CS/IT or related field.
• Proven ETL data engineering experience with Python/PySpark.
• Proficiency with Azure Synapse Analytics resources (Notebooks, Pipelines, Key Vault).
• Strong SQL skills (SparkSQL and MS SQL) for data extraction/loading.
• Knowledge of data integration best practices and tools.
• Experience with Git/Azure DevOps.
• Strong problem-solving, analytical skills and attention to detail.
• Excellent communication and teamwork abilities.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse Notebooks/Pipelines.
• Design data storage structures with star schemas, facts and dimensions in an MPP SQL pool.
• Extract data from REST APIs, SQL tables, and CSV files.
• Optimize notebooks/pipelines for scalability and performance in Azure Synapse.
• Contribute to data fabric concepts like data lakes, lakehouses and data cataloging.
• Collaborate with data architects to model data per business needs.
• Implement data quality checks and validation processes.
• Monitor ETL jobs, diagnose issues and resolve bottlenecks.
• Maintain documentation of ETL processes and data flows.
• Support data-related initiatives with cross-functional teams.
• Ensure data security and governance compliance.

Conocimientos

ETL data engineering with PySpark

Azure Synapse Analytics

SQL queries (SparkSQL/MS SQL)

Git / Azure DevOps

Power BI / Tableau

Python

Data quality

Collaborative teamwork

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Azure Key Vault

Linked Services

Descripción del empleo

Bluelight is seeking a skilled Data Engineer to design, develop and maintain ETL data pipelines using PySpark in Azure Synapse Analytics. You will pull data from REST APIs, SQL tables and CSV files, transform it into reliable, scalable datasets, and ensure efficient execution within the Synapse notebooks or pipelines.

The role requires collaborating with data architects to build star-schema models, implement data quality checks, monitor jobs, and participate in data governance and security