Remote Azure Data Engineer — ETL & Synapse Expert

Bluelight Consulting LLC; Guadalupe; A distancia; MXN 781.200 - 1.227.600; Jornada completa

Descripción de la vacante

Bluelight Consulting LLC is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) and Azure Synapse Analytics. You will work closely with data scientists and analysts to ensure accurate, accessible analytical data for decision-making, contributing to challenging projects in a growing consultancy.

The role emphasizes data quality, scalable pipelines, and collaboration within a dynamic team, with opportunities for professional growth and

Formación

• Bachelor’s degree in Computer Science, IT, or related field or equivalent.
• Significant ETL experience using Python (PySpark) to extract, transform, and load data.
• Proficient with Azure Synapse Analytics resources: Notebooks, Pipelines, Linked Services, Key Vault.
• Strong SQL skills with SparkSQL and MS SQL, optimizing queries.
• Experience with Git/Azure DevOps and data governance knowledge.

Responsabilidades

• Develop and maintain ETL data pipelines using PySpark in Azure Synapse.
• Design data warehouses with star schemas, facts, and dimensions.
• Extract data from REST APIs, SQL tables, and CSV files.
• Optimize notebooks/pipelines for scalability and performance.
• Implement data quality checks and data governance practices.
• Collaborate with data architects to model data.
• Monitor ETL jobs and resolve bottlenecks to meet SLAs.
• Document ETL processes and data flows.

Conocimientos

Python (PySpark)

Azure Synapse Analytics

SQL (SparkSQL/MS SQL)

REST APIs

ETL

Educación

Bachelor’s degree in CS/IT or related

Azure Data Engineer certification (preferred)

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Git (Azure DevOps)

Power BI

Descripción del empleo

Bluelight Consulting LLC is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) and Azure Synapse Analytics. You will work closely with data scientists and analysts to ensure accurate, accessible analytical data for decision-making, contributing to challenging projects in a growing consultancy.

The role emphasizes data quality, scalable pipelines, and collaboration within a dynamic team, with opportunities for professional growth and