Azure Synapse ETL Engineer | PySpark

Bluelightconsulting; Mexicali; A distancia; MXN 400.000 - 700.000; Jornada completa

Descripción de la vacante

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data integration processes primarily using Python (PySpark) and Azure Synapse Analytics. You will work with data scientists, analysts, and stakeholders to ensure accurate, reliable data for insights in a fast-paced environment where collaboration is valued.

Responsibilities include building ETL pipelines, modeling data, optimizing performance, and ensuring security and compliance within data governance standards.

Formación

• Bachelor’s degree in Computer Science, Information Technology, or related field; or equivalent work experience.
• Proven experience with ETL data engineering using Python (PySpark) for REST APIs, SQL tables, and CSV files.
• Proficiency with Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
• Ability to write complex SQL queries, optimize performance, and work with SparkSQL and MS SQL.
• Knowledge of data integration best practices and tools.
• Experience with version control systems, such as Git (Azure DevOps).
• Strong problem-solving and analytical skills with attention to detail.

Responsabilidades

• ETL Data Engineering: Develop and maintain ETL processes using Python (PySpark) in Azure Synapse Notebooks and Pipelines.
• Data Warehousing: Design and build data storage structures in an MPP SQL pool with star schemas, facts and dimensions.
• Data Source Expertise: Extract data from REST APIs, SQL tables, and CSV files.
• Azure Synapse Analytics Expertise: Design and optimize notebooks/pipelines for scalability and performance.
• Data Fabric Concepts: Contribute to data lakes, lakehouses, delta lakes, and data cataloging.
• Data Modeling: Create data models and schemas in collaboration with data architects.
• Data Quality: Implement data quality checks and validation processes.
• Performance Tuning: Identify bottlenecks and optimize ETL workloads to meet SLAs.

Conocimientos

Communication skills

Analytical thinking

Team collaboration

Attention to detail

Educación

Bachelor’s degree in Computer Science or related field

Azure Data Engineer certification (plus)

Herramientas

Python

PySpark

Azure Synapse Analytics

SQL

Git (Azure DevOps)

Power BI

Tableau

Descripción del empleo

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data integration processes primarily using Python (PySpark) and Azure Synapse Analytics. You will work with data scientists, analysts, and stakeholders to ensure accurate, reliable data for insights in a fast-paced environment where collaboration is valued.

Responsibilities include building ETL pipelines, modeling data, optimizing performance, and ensuring security and compliance within data governance standards.