Senior Data Engineer: Azure Fabric & Databricks Expert

Acuity Analytics; Lisboa; Presencial; EUR 65 000 - 90 000; Tempo integral

Resumo da oferta

Acuity Analytics is seeking a Senior Data Engineer to design, build and optimise modern data platforms on the Microsoft Azure ecosystem. You will develop scalable data pipelines, transform complex datasets and help organisations unlock value from data using Fabric, Databricks and Azure services.

Work with a collaborative engineering team to deliver cloud-native data solutions with a focus on performance, scalability and best practices across enterprise data platforms.

Qualificações

• 5+ years experience as a Data Engineer.
• Strong PySpark experience.
• Advanced SQL skills.
• Experience with Microsoft Fabric, Azure Databricks and/or Azure Synapse Analytics.
• Experience building data pipelines using Azure Data Factory, Synapse Pipelines or Fabric Data Factory.
• Experience working with cloud-based data platforms.
• Excellent problem-solving and communication skills.

Responsabilidades

• Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse.
• Develop ETL/ELT solutions using PySpark and SQL.
• Build and optimise data integration solutions using Azure Data Factory and Microsoft Fabric.
• Design scalable lakehouse and data warehouse solutions.
• Optimise data performance, reliability and quality across cloud platforms.
• Collaborate with data scientists, analysts and software engineers to deliver business solutions.
• Implement data governance, security and best practices.
• Participate in code reviews and contribute to engineering standards.
• Troubleshoot production issues and continuously improve platform performance.

Conhecimentos

PySpark

SQL

Problem solving

Communication

Ferramentas

Microsoft Fabric

Azure Databricks

Azure Synapse Analytics

Azure Data Factory

Synapse Pipelines

Descrição da oferta de emprego

Acuity Analytics is seeking a Senior Data Engineer to design, build and optimise modern data platforms on the Microsoft Azure ecosystem. You will develop scalable data pipelines, transform complex datasets and help organisations unlock value from data using Fabric, Databricks and Azure services.

Work with a collaborative engineering team to deliver cloud-native data solutions with a focus on performance, scalability and best practices across enterprise data platforms.