Azure Data Engineer: ETL, PySpark & Synapse Expert

Bluelightconsulting; Trujillo; A distancia; PEN 204.429 - 306.644; Jornada completa

Descripción de la vacante

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data pipelines using Python (PySpark) within Azure Synapse Analytics. You will ensure accurate, available analytical data and collaborate with data scientists, analysts, and stakeholders to deliver high-quality insights.

The role emphasizes data quality, performance optimization, and documentation in a fast-paced, growth-focused environment across the Americas.

Formación

• Proven experience in ETL data engineering with Python (PySpark) for data extraction, transformation and loading from REST APIs, SQL databases and CSV files.
• Experience with Azure Synapse resources including Notebooks, Pipelines, Linked Services and Key Vault.
• Strong SQL skills (SparkSQL and MS SQL) and ability to optimize queries.
• Familiarity with data integration best practices, governance and tooling.

Responsabilidades

• Develop and maintain ETL data pipelines to ensure accurate data extraction, transformation and loading.
• Design and implement data warehousing schemas (star schemas, facts, dimensions).
• Extract data from REST APIs, SQL databases, and CSV files; ensure data quality and reliability.
• Collaborate with data scientists and analysts to deliver high-quality data for insights.
• Monitor ETL jobs, troubleshoot issues and optimize performance to meet SLAs.
• Maintain documentation of data flows, transformations and pipelines.

Conocimientos

Python

PySpark

Azure Synapse Analytics

SQL

Data Quality

Git (Azure DevOps)

Power BI/Tableau

Communication

Educación

Bachelor’s degree in Computer Science/IT or related field

Herramientas

Azure Synapse Notebooks

Azure Synapse Pipelines

Linked Services

Azure Key Vault

Descripción del empleo

Bluelight is seeking an ETL Data Engineer to design, develop, and maintain data pipelines using Python (PySpark) within Azure Synapse Analytics. You will ensure accurate, available analytical data and collaborate with data scientists, analysts, and stakeholders to deliver high-quality insights.

The role emphasizes data quality, performance optimization, and documentation in a fast-paced, growth-focused environment across the Americas.