Remote Data Engineer – Azure PySpark & ETL

Bluelight Consulting LLC; Mexicali; A distancia; MXN 400.000 - 700.000; Jornada completa

Descripción de la vacante

Bluelight Consulting LLC seeks an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) and Azure Synapse Analytics. You will collaborate with data scientists and analysts to deliver high-quality analytic data for decision-making in a fast-paced consultancy environment.

The role requires strong SQL, data warehousing, and Git/Azure DevOps experience, with a focus on scalable, secure data pipelines and data governance.

Formación

• Bachelor's degree in Computer Science, Information Technology, or related field; or equivalent experience with data-engineering certifications a plus.
• Significant experience in ETL using Python (PySpark) for REST APIs, SQL tables, and CSV files.
• Proficiency with Azure Synapse resources including Notebooks, Pipelines, Linked Services, and Key Vault.
• Strong SQL skills; experience with SparkSQL and MS SQL for ETL tasks.
• Familiarity with data integration best practices, version control (Git/Azure DevOps).
• Excellent problem-solving, communication, and teamwork in fast-paced environments.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse.
• Design data models and schemas with data architects to meet business needs.
• Extract data from REST APIs, SQL tables, and CSV files; ensure data quality and governance.
• Monitor pipelines, diagnose issues, and optimize performance to meet SLAs.
• Collaborate with data scientists and analysts to deliver reliable analytics-ready data.
• Document data flows, transformations, and architectures for maintainability.

Conocimientos

PySpark

Python

Azure Synapse

SQL

Git

Data Warehousing

Communication

Agile

Power BI

Tableau

Educación

Bachelor's degree in CS/IT

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

SparkSQL

MS SQL

Power BI

Tableau

Descripción del empleo

Bluelight Consulting LLC seeks an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) and Azure Synapse Analytics. You will collaborate with data scientists and analysts to deliver high-quality analytic data for decision-making in a fast-paced consultancy environment.

The role requires strong SQL, data warehousing, and Git/Azure DevOps experience, with a focus on scalable, secure data pipelines and data governance.