Remote Azure Data Engineer - PySpark & Synapse ETL

Bluelight Consulting LLC; Guanajuato; A distancia; MXN 1.046.389 - 2.092.779; Jornada completa

Descripción de la vacante

Bluelight Consulting LLC is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics. You will work closely with data scientists and analysts to ensure accurate, accessible data for insights, while contributing to data governance and scalable architectures.

The role emphasizes collaboration, continuous learning, and delivering high-quality data solutions in a dynamic consultancy environment.

Formación

• ETL data engineering with PySpark across REST APIs, SQL DBs, and CSVs.
• Proficiency in Azure Synapse resources (Notebooks, Pipelines, Linked Services, Key Vault).
• Strong SQL skills (SparkSQL, MS SQL) and data integration best practices.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse.
• Design data warehouse structures (star schemas, facts, dimensions).
• Extract data from REST APIs, SQL tables, and CSV files.
• Optimize notebooks/pipelines for scalability and performance.
• Collaborate with data architects to model data for business needs.
• Implement data quality checks and monitor ETL jobs to meet SLAs.
• Document data flows, transformations, and processes.

Conocimientos

PySpark

ETL data engineering

SQL proficiency

Data warehousing

Problem solving

Educación

Bachelor's degree in CS/IT

Azure Data Engineer certification (plus)

Herramientas

Azure Synapse

Notebooks

Pipelines

Azure DevOps

Git

Power BI

Tableau

Descripción del empleo

Bluelight Consulting LLC is seeking an ETL Data Engineer to design, develop, and maintain data integration pipelines using Python (PySpark) within Azure Synapse Analytics. You will work closely with data scientists and analysts to ensure accurate, accessible data for insights, while contributing to data governance and scalable architectures.

The role emphasizes collaboration, continuous learning, and delivering high-quality data solutions in a dynamic consultancy environment.