Remote Azure PySpark Data Engineer - ETL & Analytics

Bluelight Consulting LLC; Monterrey; A distancia; MXN 600.000 - 1.200.000; Jornada completa

Descripción de la vacante

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data pipelines using Python (PySpark) and Azure Synapse Analytics for our client projects. You will work closely with data scientists, analysts, and stakeholders in a fast-paced consultancy environment.

The role focuses on building scalable ETL processes, applying data warehousing concepts, validating data quality, and ensuring secure data flows across environments.

Formación

• Develop and maintain ETL data pipelines using PySpark in Azure Synapse.
• Design data storage structures with star schemas for scalable MPP workloads.
• Extract data from REST APIs, SQL databases, and CSV files.
• Optimize notebooks and pipelines for performance and scalability.
• Ensure data quality, security, and governance across pipelines.

Responsabilidades

• Monitor ETL jobs and diagnose issues to meet SLAs.
• Document data flows and transformations comprehensively.
• Collaborate with data architects to model data aligned with requirements.
• Support cross-functional data initiatives with stakeholders.

Conocimientos

Python (PySpark)

Azure Synapse Analytics

ETL/Data Integration

SQL

Data Warehousing

Git (Azure DevOps)

Data Visualization (Power BI/Tableau)

Educación

Bachelor’s degree in Computer Science, Information Technology, or related field

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Git (Azure DevOps)

Descripción del empleo

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data pipelines using Python (PySpark) and Azure Synapse Analytics for our client projects. You will work closely with data scientists, analysts, and stakeholders in a fast-paced consultancy environment.

The role focuses on building scalable ETL processes, applying data warehousing concepts, validating data quality, and ensuring secure data flows across environments.