Azure Data Engineer: PySpark ETL & Synapse Expert

Bluelightconsulting; Buenos Aires; A distancia; ARS 132.725.744 - 191.714.963; Jornada completa

Descripción de la vacante

Bluelightconsulting is hiring an ETL Data Engineer in Argentina to design, develop and maintain data pipelines using Python (PySpark) and Azure Synapse Analytics. You will work with data scientists and analysts to ensure accurate, available analytics data and scalable processing solutions.

The role focuses on building data warehouses, integrating data from REST APIs, SQL sources and CSV files, and ensuring data quality, security and governance in a fast-paced environment.

Formación

• Bachelor's degree in computer science, information technology, or a related field or equivalent work experience.
• Proven ETL data engineering with PySpark extracting from REST APIs, SQL tables, and CSV files.
• Proficiency with Azure Synapse analytics resources including Notebooks, Pipelines, and key vaults.
• Strong SQL skills (SparkSQL and MS SQL) for data extraction, transformation and loading.
• Knowledge of data integration best practices and tools; experience with Git/Azure DevOps.
• Excellent communication, problem solving and team collaboration abilities.

Responsabilidades

• Develop and maintain ETL data pipelines using Python (PySpark) in Azure Synapse Notebooks/Pipelines.
• Design and build data warehouses with star schemas in an MPP DW environment.
• Extract data from REST APIs, SQL tables, and CSV files for analytics.
• Optimize notebooks/pipelines for scalability, performance and SLA compliance.
• Implement data quality checks and monitor data pipelines for reliability.
• Document ETL processes, data flows and transformations for governance.
• Collaborate with cross‑functional teams; ensure data security and compliance.

Educación

Bachelor's degree in Computer Science, Information Technology, or related field

Herramientas

Azure Synapse Analytics

Azure Synapse Notebooks

Azure Synapse Pipelines

Git (Azure DevOps)

Descripción del empleo

Bluelightconsulting is hiring an ETL Data Engineer in Argentina to design, develop and maintain data pipelines using Python (PySpark) and Azure Synapse Analytics. You will work with data scientists and analysts to ensure accurate, available analytics data and scalable processing solutions.

The role focuses on building data warehouses, integrating data from REST APIs, SQL sources and CSV files, and ensuring data quality, security and governance in a fast-paced environment.