Remote Azure Data Engineer (PySpark) for ETL & Analytics

Bluelight Consulting, Llc; Tijuana; A distancia; MXN 420.000 - 660.000; Jornada completa

Descripción de la vacante

Bluelight Consulting, Llc seeks an ETL Data Engineer to design, develop, and maintain Python (PySpark) ETL pipelines in Azure Synapse Analytics. You will work with data scientists and analysts to ensure accurate, accessible analytical data, while contributing to data modeling, quality checks, and documentation.

In this consulting role, you will engage with clients across the Americas, leveraging modern data platforms to deliver scalable solutions and drive continuous learning and professional

Formación

• Bachelor’s degree in Computer Science, Information Technology, or related field; or equivalent work experience, with Azure Data Engineer certs a plus.
• Proven experience in ETL data engineering with Python (PySpark) for data extraction, transformation, and loading.
• Proficiency with Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Key Vault.
• Strong SQL skills; able to work with SparkSQL and MS SQL for ETL.
• Familiarity with data integration best practices and Git-based version control.
• Excellent communication and collaboration skills in a fast-paced team environment.

Responsabilidades

• ETL Data Engineering: Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse Notebooks or Pipelines.
• Data Warehousing: Design data storage structures in an MPP SWL pool using star schemas.
• Data Source Expertise: Extract data from REST APIs, SQL databases, and CSV files.
• Azure Synapse Analytics Expertise: Optimize notebooks/pipelines for scalability and performance.
• Data Fabric Concepts: Contribute to data lakes, lakehouses, delta lakes, and data cataloging.
• Data Modeling: Collaborate with data architects to create aligned data models.
• Data Quality: Implement data quality checks and validation processes.
• Performance Tuning: Identify bottlenecks and optimize ETL workloads.
• Monitoring and Troubleshooting: Monitor ETL jobs and resolve issues.
• Documentation: Maintain thorough documentation of data flows and transformations.
• Collaboration: Work with cross-functional teams; support data initiatives.
• Security and Compliance: Ensure data governance and privacy compliance.

Conocimientos

Python

PySpark

Azure Synapse Analytics

ETL

SQL

Data Warehousing

REST APIs

CSV Files

Git / Azure DevOps

Educación

Bachelor’s degree in Computer Science or related field

Herramientas

Azure Synapse Analytics

Power BI

Tableau

Git (Azure DevOps)

Descripción del empleo

Bluelight Consulting, Llc seeks an ETL Data Engineer to design, develop, and maintain Python (PySpark) ETL pipelines in Azure Synapse Analytics. You will work with data scientists and analysts to ensure accurate, accessible analytical data, while contributing to data modeling, quality checks, and documentation.

In this consulting role, you will engage with clients across the Americas, leveraging modern data platforms to deliver scalable solutions and drive continuous learning and professional