Azure Data Engineer - ETL & Analytics

Bluelightconsulting; Saltillo; A distancia; MXN 520.000 - 800.000; Jornada completa

Descripción de la vacante

Bluelightconsulting is seeking an ETL Data Engineer to design and maintain data pipelines using Python (PySpark) and Azure Synapse Analytics, ensuring accurate, accessible analytics for clients. You will work closely with data scientists and analysts to deliver high-quality data for insights in a fast-paced, collaborative environment.

The role emphasizes data modeling, quality checks, performance tuning, and governance, with a focus on scalable data solutions and reliable pipelines across

Formación

• Bachelor’s degree or equivalent work experience in a related field.
• Proven ETL development experience with Python/PySpark and data integration from REST APIs, SQL databases, and CSV files.
• Strong SQL skills with SparkSQL and MS SQL for data extraction and transformation.
• Experience with Azure Synapse resources including Notebooks and Pipelines.
• Familiarity with data governance and best practices.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse.
• Design and optimize data notebooks/pipelines for scalable performance.
• Construct data models and schemas aligned with business needs.
• Implement data quality checks and validation processes.
• Monitor ETL jobs, diagnose issues, and ensure pipeline reliability.
• Collaborate with data scientists, analysts, and stakeholders to meet requirements.
• Document data flows, transformations, and architecture.

Conocimientos

Python (PySpark)

SQL (SparkSQL/MS SQL)

Azure Synapse Analytics

ETL development

REST APIs

Data Warehousing

Data Modeling

Data Quality

Performance Tuning

Monitoring & Troubleshooting

Documentation

Collaboration

Azure DevOps / Git

Big data concepts

Power BI / Tableau

Educación

Bachelor’s degree in Computer Science / IT or related field

Herramientas

Azure Synapse Analytics

Azure Notebooks

Azure Pipelines

Git (Azure DevOps)

SQL tools

Power BI

Descripción del empleo

Bluelightconsulting is seeking an ETL Data Engineer to design and maintain data pipelines using Python (PySpark) and Azure Synapse Analytics, ensuring accurate, accessible analytics for clients. You will work closely with data scientists and analysts to deliver high-quality data for insights in a fast-paced, collaborative environment.

The role emphasizes data modeling, quality checks, performance tuning, and governance, with a focus on scalable data solutions and reliable pipelines across