Azure Data Engineer - ETL & Synapse Pipelines

Bluelightconsulting; Chihuahua; A distancia; MXN 420.000 - 640.000; Jornada completa

Descripción de la vacante

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) and Azure Synapse, ensuring reliable analytics for client projects. You will collaborate with data scientists, analysts, and stakeholders to deliver trustworthy data, implement data quality checks, and optimize notebooks and pipelines for performance.

This role offers a fast-paced environment, cross-functional teamwork, and growth opportunities within Bluelight.

Formación

• Bachelor's degree in Computer Science, Information Technology, or a related field; or equivalent work experience, with Azure Data Engineer certification a plus.
• Proven experience in ETL data engineering with Python (PySpark) to extract, transform, and load from REST APIs, SQL tables, and CSV files.
• Proficiency with Azure Synapse resources including Notebooks, Pipelines, Linked Services, and Key Vault.
• Demonstrated ability to write complex SQL queries and optimize performance using SparkSQL and MS SQL.
• Knowledge of data integration best practices and tools.
• Experience with version control systems, such as Git (Azure DevOps).
• Strong problem-solving and analytical skills with attention to detail.
• Excellent communication and teamwork in cross-functional environments.

Responsabilidades

• ETL Data Engineering: Develop and maintain ETL processes using Python (PySpark) within Azure Synapse Notebooks/Pipelines to ensure efficient data extraction, transformation, and loading.
• Data Warehousing: Design and build data storage structures in an MPP SQL pool with star schemas, facts, and dimensions.
• Data Source Expertise: Extract data from REST APIs, SQL tables, and CSV files.
• Azure Synapse Analytics Expertise: Optimize notebooks/pipelines for scalability and performance.
• Data Modeling: Create data models and schemas aligned with business requirements.
• Data Quality: Implement data quality checks and validation processes.
• Performance Tuning: Identify bottlenecks and optimize ETL pipelines to meet SLAs.
• Monitoring and Troubleshooting: Monitor jobs and resolve issues to ensure reliability.
• Documentation: Maintain comprehensive data flow and transformation documentation.
• Collaboration: Work with cross-functional teams to support data initiatives and governance.

Conocimientos

Python (PySpark)

Azure Synapse Analytics

SQL

REST APIs

CSV files

SparkSQL / MS SQL

Git (Azure DevOps)

Power BI

Tableau

Educación

Bachelor's degree in Computer Science / IT or related field

Herramientas

Azure Synapse Analytics Notebooks

Azure Synapse Pipelines

Linked Services

Azure Key Vault

Git (Azure DevOps)

Descripción del empleo

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) and Azure Synapse, ensuring reliable analytics for client projects. You will collaborate with data scientists, analysts, and stakeholders to deliver trustworthy data, implement data quality checks, and optimize notebooks and pipelines for performance.

This role offers a fast-paced environment, cross-functional teamwork, and growth opportunities within Bluelight.