Remote Azure Data Engineer - ETL & Analytics Specialist

Bluelight Consulting LLC; Ecatepec de Morelos; A distancia; MXN 420.000 - 680.000; Jornada completa

Descripción de la vacante

Bluelight Consulting LLC is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) and Azure Synapse Analytics to ensure accurate, available analytical data.

You will collaborate with data scientists, analysts, and stakeholders in a fast-paced consultancy, delivering scalable data solutions while upholding data quality and security across client engagements.

Formación

• Bachelor's degree in Computer Science, Information Technology, or related field; certifications in data engineering (e.g., Azure Data Engineer) are a plus.
• Proven ETL data engineering experience with Python (PySpark) for data extraction, transformation, and loading from REST APIs, SQL databases, and CSV files.
• Proficiency with Azure Synapse Analytics resources including Notebooks and Pipelines.
• Ability to write complex SQL queries and work with SparkSQL and MS SQL for data processing.
• Knowledge of data integration best practices and tools.
• Experience with version control systems like Git (Azure DevOps).
• Strong problem-solving, analytical skills, and clear communication, with teamwork in shifting priorities.
• Familiarity with big data, ML, data analysis; experience with Power BI/Tableau is a plus.

Responsabilidades

• Develop and maintain ETL data pipelines using PySpark in Azure Synapse for reliable data extraction, transformation, and loading.
• Design data storage structures using star schemas and dimensions for efficient analytics.
• Extract data from REST APIs, SQL tables, and CSV files; ensure scalability and performance of notebooks/pipelines.
• Optimize pipelines to meet SLAs and monitor job reliability.
• Maintain documentation of data flows, transformations, and storage models.
• Collaborate with data architects and analysts to meet business requirements.
• Ensure data security and compliance with governance and privacy standards.

Conocimientos

Python (PySpark)

SQL

Azure Synapse Analytics

REST APIs

Data Warehousing

SparkSQL

Git

Communication

Educación

Bachelor's in CS/IT or equivalent

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Linked Services

Azure Key Vault

Descripción del empleo

Bluelight Consulting LLC is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) and Azure Synapse Analytics to ensure accurate, available analytical data.

You will collaborate with data scientists, analysts, and stakeholders in a fast-paced consultancy, delivering scalable data solutions while upholding data quality and security across client engagements.