Azure Data Engineer: ETL & Analytics Specialist

Bluelightconsulting; Nezahualcóyotl; A distancia; MXN 480.000 - 840.000; Jornada completa

Descripción de la vacante

Bluelightconsulting is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) in Azure Synapse. You will develop scalable data warehouses, extract data from REST APIs, SQL databases, and CSV files, and ensure data quality with robust monitoring.

The role involves collaborating with data scientists and analysts to deliver reliable analytical data and participate in governance and security practices within a fast-paced environment.

Formación

• Bachelor’s degree in Computer Science, Information Technology, or related field (or equivalent).
• Proven ETL experience with Python/PySpark for data extraction and loading.
• Experience with Azure Synapse resources (Notebooks/Pipelines).
• Strong SQL skills (SparkSQL and MS SQL).
• Knowledge of data integration best practices and tools.
• Experience with version control (Git/Azure DevOps).
• Excellent analytical and communication skills.

Responsabilidades

• Develop and maintain ETL processes using Python (PySpark) in Azure Synapse notebooks/pipelines.
• Design data warehouses with star schemas, facts and dimensions for scalable storage.
• Extract data from REST APIs, SQL tables, and CSV files.
• Optimize data notebooks/pipelines for performance and scalability.
• Collaborate with data architects on models and schemas.
• Implement data quality checks and monitoring to ensure accuracy.
• Document data flows, transformations, and pipelines.
• Support data governance and security requirements.
• Coordinate with cross-functional teams on data initiatives.

Conocimientos

Python/PySpark

Azure Synapse

SQL (SparkSQL/MS SQL)

Data modeling

ETL/data integration

REST APIs

Git/Azure DevOps

Power BI/Tableau

Big data technologies

Data quality

Educación

Bachelor’s degree in CS/IT or related

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Linked Services

Azure Key Vault

Descripción del empleo

Bluelightconsulting is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) in Azure Synapse. You will develop scalable data warehouses, extract data from REST APIs, SQL databases, and CSV files, and ensure data quality with robust monitoring.

The role involves collaborating with data scientists and analysts to deliver reliable analytical data and participate in governance and security practices within a fast-paced environment.