Remote Azure Data Engineer — ETL & Analytics

Bluelight Consulting LLC; Mérida; A distancia; MXN 600.000 - 1.200.000; Jornada completa

Descripción de la vacante

Bluelight Consulting LLC is seeking an ETL Data Engineer to design, build, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics Notebooks and Pipelines. You will extract data from REST APIs, SQL sources, and CSV files, ensuring reliable, scalable data flows for analytics teams.

The role emphasizes data warehousing, governance, and collaboration with data scientists, analysts, and stakeholders in a fast-paced consultancy environment.

Formación

• Bachelor’s degree in Computer Science, Information Technology, or related field; or equivalent work experience; Azure Data Engineer certs a plus.
• Proven ETL data engineering with Python/PySpark to extract/transform/load from REST APIs, SQL databases, and CSVs.
• Proficient with Azure Synapse resources including Notebooks, Pipelines, Linked Services, and Key Vault.
• Strong SQL skills, SparkSQL and MS SQL for data extraction, transformation, and loading.
• Knowledge of data integration best practices, tools, and version control (Git/Azure DevOps).
• Excellent communication and teamwork; ability to adapt to changing priorities.

Responsabilidades

• Develop and maintain ETL data engineering processes using Python (PySpark) within Azure Synapse Notebooks and Pipelines to ensure efficient data extraction, transformation, and loading.
• Design and build data storage structures using star schemas, facts, and dimensions in an MPP SQL pool.
• Extract data from REST APIs, SQL tables, and CSV files; optimize notebooks/pipelines for scalability and performance.
• Collaborate with data architects to model data that aligns with business needs.
• Implement data quality checks and data governance measures to ensure accuracy and security.
• Monitor pipelines, diagnose issues, and improve performance to meet SLAs.
• Document ETL processes, data flows, and transformations; support cross-functional data needs.

Conocimientos

ETL data engineering

Python (PySpark)

SQL

Data modeling

Data governance

Communication skills

Educación

Bachelor’s degree in CS/IT or equivalent

Herramientas

Azure Synapse Analytics

Azure Notebooks/Pipelines

Linked Services

Azure Key Vault

Git (Azure DevOps)

Descripción del empleo

Bluelight Consulting LLC is seeking an ETL Data Engineer to design, build, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics Notebooks and Pipelines. You will extract data from REST APIs, SQL sources, and CSV files, ensuring reliable, scalable data flows for analytics teams.

The role emphasizes data warehousing, governance, and collaboration with data scientists, analysts, and stakeholders in a fast-paced consultancy environment.