Azure Data Engineer: ETL & Synapse Expert

Bluelightconsulting; Aguascalientes; A distancia; MXN 550.000 - 950.000; Jornada completa

Descripción de la vacante

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) in Azure Synapse Analytics. You will optimize data notebooks and pipelines, ensuring data quality, performance, and scalable data models to support analytics needs.

You will collaborate with data scientists, analysts, and stakeholders to deliver reliable data for insights, while following governance and security best practices in a dynamic, growth-focused consultancy

Formación

• Bachelor's degree in Computer Science, Information Technology, or related field; certifications in data engineering/data science (e.g., Azure Data Engineer) are a plus.
• Proven ETL data engineering experience using Python (PySpark) for data extraction, transformation, and loading from REST APIs, SQL databases, and CSV files.
• Proficiency with Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
• Demonstrated ability to write complex SQL queries, optimize performance, and work with SparkSQL and MS SQL for ETL.
• Knowledge of data integration best practices, tools, and version control (Git/Azure DevOps).
• Strong problem-solving and communication skills; ability to collaborate across teams.

Responsabilidades

• ETL Data Engineering: Develop and maintain ETL processes using Python (PySpark) within Azure Synapse Notebooks and Pipelines.
• Data Warehousing: Design and build storage structures in an MPP SWL Pool with star schemas and dimension tables.
• Data Source Expertise: Extract data from REST APIs, SQL tables, and CSV files.
• Azure Synapse Analytics Expertise: Optimize notebooks/pipelines for scalability and performance.
• Data Modeling: Collaborate with data architects to create aligned data models.
• Data Quality and Monitoring: Implement checks and monitor ETL jobs for SLA adherence.
• Documentation: Maintain comprehensive documentation of data flows and transformations.
• Collaboration: Work with cross-functional teams on data requirements and governance.

Conocimientos

PySpark

Python

SQL

Data Integration

Agile Methodologies

Power BI

Educación

Bachelor's degree in Computer Science / IT

Herramientas

Azure Synapse Analytics

Notebooks

Pipelines

Azure Key Vault

Git/Azure DevOps

Descripción del empleo

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) in Azure Synapse Analytics. You will optimize data notebooks and pipelines, ensuring data quality, performance, and scalable data models to support analytics needs.

You will collaborate with data scientists, analysts, and stakeholders to deliver reliable data for insights, while following governance and security best practices in a dynamic, growth-focused consultancy