Azure Data Engineer (PySpark) – ETL & Data Warehousing

Bluelightconsulting; Ciudad de Mendoza; A distancia; ARS 1.200.000 - 2.200.000; Jornada completa

Descripción de la vacante

Bluelightconsulting is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) within Azure Synapse Analytics. You will collaborate with data scientists and analysts to ensure accurate, available data for insights within a fast-paced environment.

The role emphasizes data modeling, quality checks, and scalable data pipelines, with experience in REST APIs, SQL, and BI tools like Power BI or Tableau as a plus.

Formación

• Bachelor's degree in Computer Science, Information Technology, or related field; or equivalent work experience, with Azure Data Engineer certification a plus.
• Proven ETL data engineering experience using Python (PySpark) for data extraction, transformation, and loading from REST APIs, SQL databases, and CSV files.
• Proficiency with Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
• Demonstrated ability to write complex SQL queries, optimize performance, and work with SparkSQL and MS SQL.
• Knowledge of data integration best practices and tools.
• Experience with Git (Azure DevOps).
• Strong problem-solving and analytical skills and attention to detail.
• Excellent verbal and written communication for cross-functional collaboration.
• Familiarity with big data, ML, data analysis and BI tools like Power BI/Tableau is a plus.

Responsabilidades

• ETL Data Engineering: Develop and maintain ETL pipelines using Python (PySpark) within Azure Synapse Notebooks and/or Pipelines to ensure efficient data extraction, transformation, and loading.
• Data Warehousing: Design and build scalable data storage structures in an MPP SQL pool using star schemas, facts and dimensions.
• Data Source Expertise: Extract data from REST APIs, SQL databases, and CSV files.
• Azure Synapse Analytics Expertise: Optimize notebooks/pipelines for scalability and performance.
• Data Modeling: Collaborate to create data models and schemas aligned with business needs.
• Data Quality: Implement quality checks and validation processes to ensure accuracy and consistency.
• Monitoring & Troubleshooting: Monitor ETL jobs, diagnose issues, and implement solutions to maintain reliability.
• Documentation: Maintain comprehensive documentation of ETL processes and data flows.

Conocimientos

Python (PySpark)

ETL

SQL

Data modeling

Data quality

Azure Synapse

Git

Analytical skills

Communication

Big data

Educación

Bachelor’s degree in Computer Science or IT

Azure Data Engineer certification (plus)

Herramientas

Azure Synapse Analytics

Power BI

Tableau

Git/Azure DevOps

Descripción del empleo

Bluelightconsulting is seeking an ETL Data Engineer to design, develop, and maintain data integration processes using Python (PySpark) within Azure Synapse Analytics. You will collaborate with data scientists and analysts to ensure accurate, available data for insights within a fast-paced environment.

The role emphasizes data modeling, quality checks, and scalable data pipelines, with experience in REST APIs, SQL, and BI tools like Power BI or Tableau as a plus.