Azure Data Engineer - ETL & Analytics with PySpark

Bluelightconsulting; Mérida; A distancia; MXN 480.000 - 720.000; Jornada completa

Descripción de la vacante

Bluelight is seeking an ETL Data Engineer in Mérida to design, develop, and maintain data integration processes using Python (PySpark) and Azure Synapse Analytics. You will collaborate with data scientists, analysts, and stakeholders to ensure reliable, high-quality data for insights and decision-making in a fast-paced environment.

Responsibilities include ETL development, data warehousing design, data quality checks, performance tuning, and thorough documentation.

Formación

• Experience building ETL data pipelines with Python (PySpark).
• Experience with REST APIs, SQL databases, and CSV data sources.
• Experience with Azure Synapse Analytics Notebooks and Pipelines.
• Ability to design scalable data warehouses with star schemas.

Responsabilidades

• Design and maintain ETL data pipelines using Python (PySpark) and Azure Synapse.
• Develop scalable data warehouse structures with star schemas.
• Extract data from REST APIs, SQL databases, and CSV files.
• Optimize notebooks/pipelines for performance and SLAs.
• Monitor ETL jobs and troubleshoot data pipelines.
• Document data flows and data transformations.
• Collaborate with data scientists and analysts.
• Ensure data security and compliance.

Conocimientos

Analytical thinking

Problem-solving

Communication

Team collaboration

Attention to detail

Adaptability

Educación

Bachelor's degree in CS/IT

Azure Data Engineer cert (plus)

Herramientas

Python (PySpark)

Azure Synapse Analytics

SQL

REST APIs

CSV files

Power BI

Tableau

Azure Key Vault

Git/Azure DevOps

Spark SQL

Descripción del empleo

Bluelight is seeking an ETL Data Engineer in Mérida to design, develop, and maintain data integration processes using Python (PySpark) and Azure Synapse Analytics. You will collaborate with data scientists, analysts, and stakeholders to ensure reliable, high-quality data for insights and decision-making in a fast-paced environment.

Responsibilities include ETL development, data warehousing design, data quality checks, performance tuning, and thorough documentation.